Stepped MoE: Segment-Level Routing with Configurable Inference Complexity
Stepped MoE combines elastic subnetworks with sparse routing so one model spans 1-4 billion parameters.
1 stories, newest first · one card per story
Stepped MoE combines elastic subnetworks with sparse routing so one model spans 1-4 billion parameters.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views