Open model inference growth tracked via startup token volumes
Original title: How well can we measure open model inference share?
Interconnects research finds open model inference is growing exponentially but remains small compared to closed models.
Interconnects analyzes open model inference market share using token volumes from Baseten, Fireworks and Together AI plus OpenRouter. Fireworks serves over 40T tokens per day to customized models, with growth over 2x since summer. Data shows near-exponential growth. Google token volumes for its full platform are used for comparison. Hyperscalers such as Amazon Bedrock have not released category breakdowns. The analysis notes open model adoption is still a rounding error relative to major closed models.
- Fireworks >40T tokens per day
- Exponential growth in open inference
- OpenRouter token volume tracked
- Amazon Bedrock usage not broken down
- Products
- Amazon Bedrock
- Organizations
- Interconnects
From the original article
2 min read at interconnects.aiOur first open model economy research note for paid subscribers.
By Nathan Lambert · interconnects.ai
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.