Multi-View MoE reuses multiple routers to shape expert computation
On a 24-layer 10B-A1B model trained on 708B tokens, nine-task mean rose 1.18 points.
Stories per day · 30 days
1 stories, newest first · one card per story
1 stories, newest first · one card per story
On a 24-layer 10B-A1B model trained on 708B tokens, nine-task mean rose 1.18 points.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views