Salesforce logo

Moirai-MoE-1.0-R-Small

Model directory
Salesforce/moirai-moe-1.0-R-small

~0.47B stored params params | CC-BY-NC-4.0 | Upstream checkpoint

Moirai-MoE-1.0-R-Small is the lightweight checkpoint in Salesforce's sparse-expert Moirai-MoE family, the smaller counterpart to Moirai-MoE-1.0-R-Base. With around 0.47B stored parameters it is the most cost-efficient way to access the Moirai-MoE design, which departs from the dense 1.0-R line by routing tokens through specialized experts instead of one monolithic network.

Architecturally it is a sparse mixture-of-experts decoder-only transformer with probabilistic output heads, sharing the same MoE routing as the Base variant but at a smaller stored size. The sparse routing activates only a subset of experts per token, which is what makes the family parameter-efficient and high-throughput at inference, while the probabilistic heads supply multivariate forecasts with calibrated quantiles. The checkpoint card is sparse; Salesforce's official Moirai-MoE materials describe large heterogeneous time-series pretraining for the setup rather than a separate narrow corpus for this exact checkpoint.

Where to run this model

Compute availability, hardware requirements, and pricing depend on the execution provider.

Hugging Face · Weights & deployment

Get model weights, deployment instructions, and current provider listings.

Hugging Face provider mappings checked 2026-10-06. No Inference Provider mapping was listed for this checkpoint.

Model Classification

Family

Moirai-MoE-1.0-R

Type

time series foundation model

Pretrained time-series model for zero-shot or few-shot forecasting workloads.

Training Data

Official checkpoint card is sparse; Salesforce's official Moirai-MoE materials describe large heterogeneous time-series pretraining in the Moirai-MoE setup rather than a separate narrow corpus for this exact checkpoint.

Recommended For

  • • Multivariate forecasting across heterogeneous domains
  • • Workloads that benefit from probabilistic outputs and arbitrary variate counts

Strengths

  • • Strong multivariate coverage across the Moirai family
  • • Well-suited to covariates and correlated series

Limitations

  • • Model cards for some newer Moirai variants are still sparse on exact checkpoint details
  • • Heavier family choices can be more expensive than tiny single-purpose baselines

Capabilities

forecastingquantile-forecastingmultivariatezero-shothigh-throughput

Tags

salesforcemoiraimoesparseefficient

Specifications

Parameters
~0.47B stored params
Architecture
sparse MoE decoder-only transformer with probabilistic output heads
Context length
n/a
Max context
n/a
Minimum history
n/a
Recommended history
n/a
Input step
n/a
Required target series
1
Temperature
Ignored
Top P
Ignored
Max output
n/a
License
CC-BY-NC-4.0

Related models