Stepped MoE: Segment-Level Routing with Configurable Inference Complexity
Stepped MoE combines elastic subnetworks with sparse routing so one model spans 1-4 billion parameters.
1 stories, newest first · one card per story
Stepped MoE combines elastic subnetworks with sparse routing so one model spans 1-4 billion parameters.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views