ID Balancing: Stable Training of Extremely Sparse MoE via PID-Based Load Control
ID Balancing uses an integral-derivative controller to stabilize extremely sparse MoE expert load during training.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #load-balancing
MCRL2: Multi-resource Cross-attention-based Representation Learning-augmented Reinforcement Learning for Cloud Microservice Scheduling
MCRL2 augments reinforcement learning with multi-resource cross-attention representations to improve cloud microservice scheduling and load balancing.