StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
StepFun released Step 5 Preview open weights: a 600B MoE with 27B active parameters and 1M context.
StepFun released Step 5 Preview as open weights, according to MarkTechPost. The model is a mixture-of-experts system with 600 billion total parameters and about 27 billion active parameters. It is reported to support a 1 million token context window. Benchmark scores and license terms are not included in the available text.
- Step 5 Preview is released with open weights.
- Architecture is a 600B MoE with 27B active parameters.
- Context window is reported at 1 million tokens.
- Vendors
- StepFun
- Organizations
- StepFun
- AI models
- Step 5 Preview
From the original article
14 min read at marktechpost.comStepFun has released Step 5 Preview as open weights. FP8 and BF16 checkpoints are live on Hugging Face and ModelScope. Step 5 Preview is a sparse Mixture-of-Experts model from StepFun built for long-horizon agentic work.
By Michal Sutter · marktechpost.com
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.