Explaining the Roles of Experts in Mixture-of-Experts LLMs for Personalization
Researchers personalize mixture-of-experts LLMs and localize distinct personalization features in specific experts.
Stories per day · 30 days
3 RSS
2 stories, newest first · one card per story
Stories tagged #sparse-routing
Graph Machine: Towards Better Pretraining via Edges
Researchers propose Graph Machine, an O(n)-state sparse architecture that replaces 75% of Qwen3-0.6B dense layers with only slight loss change.