Time-MoE-50M
Model directoryMaple728/TimeMoE-50M0.1B total / 50M active params | Apache-2.0 | Upstream checkpoint
Time-MoE-50M is the smaller public checkpoint in Xiaohongshu's Time-MoE family. The family naming refers to its active-parameter regime: this checkpoint activates roughly 50M parameters per forward pass even though it stores about 0.1B in total, because the inactive experts remain part of the release. It is the lightest public way to evaluate the sparse Time-MoE design.
Architecturally it is a decoder-only transformer with sparse Mixture-of-Experts routing, which lets it reach for large-capacity behavior without paying the full dense compute cost on every token. It is pretrained on Time-300B, the multi-domain corpus spanning more than nine domains and over 300B time points described in the official paper and repository, and it is released under Apache-2.0.
Where to run this model
Compute availability, hardware requirements, and pricing depend on the execution provider.
Get model weights, deployment instructions, and current provider listings.
Hugging Face provider mappings checked 2026-10-06. No Inference Provider mapping was listed for this checkpoint.
Model Classification
Family
Time-MoE
Type
time series foundation model
Pretrained time-series model for zero-shot or few-shot forecasting workloads.
Resources
Training Data
Time-300B, a multi-domain corpus spanning more than nine domains and over 300B time points, per the official paper and repository.
Recommended For
- • Long-context forecasting with sparse-expert scaling
- • Teams exploring MoE behavior in time-series foundation models
Strengths
- • Sparse experts offer large-capacity behavior without a fully dense footprint
- • Well aligned to long-context autoregressive forecasting
Limitations
- • MoE operational behavior can be less familiar than dense baselines
- • Not the best first pick if you just need a simple compact deployment
Capabilities
Tags
Specifications
- Parameters
- 0.1B total / 50M active
- Architecture
- decoder-only transformer with sparse Mixture-of-Experts routing
- Context length
- n/a
- Max context
- n/a
- Minimum history
- n/a
- Recommended history
- n/a
- Input step
- n/a
- Required target series
- 1
- Temperature
- Ignored
- Top P
- Ignored
- Max output
- n/a
- License
- Apache-2.0