Skip to main content
Back

Amazon's Chronos-T5 Treats Numbers Like Words to Hit 1M Monthly Downloads

Amazon's Chronos-T5 base turns time series into tokens and forecasts them like a language model, with over a million monthly downloads.

  • Amazon Chronos-T5 base is a 200M parameter time series foundation model built on T5.
  • It tokenizes numerical series via scaling and quantization, then trains with cross-entropy loss.
  • Pretrained on public datasets plus Gaussian process synthetic data for stronger zero-shot generalization.
  • Benchmarked across 42 datasets, matching or beating specialist models in zero-shot settings.
  • Chronos-Bolt offers up to 250x faster inference and 5% lower error at same size.
  • Newer Chronos-2 extends the framework toward universal, multivariate forecasting.

Amazon's Chronos-T5 base keeps drawing developers to Hugging Face, crossing a million monthly downloads for a 200M parameter time series foundation model that borrows the T5 language model recipe and applies it to numerical sequences. Treat a time series like a sentence, tokenize the numbers, and let a transformer predict what comes next.

Time series as a foreign language

Chronos is a framework for pretrained probabilistic time series models. It tokenizes values through scaling and quantization into a fixed vocabulary, then trains transformer-based language model architectures on those tokens using cross-entropy loss. At inference, the model autoregressively samples token sequences and maps them back to numerical values, producing a full predictive distribution rather than a single point estimate.

Chronos architecture: tokenization, training with cross-entropy loss, and inference with probabilistic forecasts

The base model sits on top of T5 with one twist: vocabulary size. Chronos-T5 uses 4,096 tokens versus 32,128 in the original T5, which is plenty to represent quantized real values and shrinks the embedding matrix considerably.

The family lineup

Chronos-T5 ships in five sizes so you can trade accuracy for latency:

  • chronos-t5-tiny: 8M parameters