IQuest-Q1 open MoE model, 320B total and 15B active, is released
The authors describe a three-stage training pipeline and model merging, and release the weights for research.
1 stories, newest first · one card per story
The authors describe a three-stage training pipeline and model merging, and release the weights for research.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views