Importance-Aware Feature Sparsification for Wireless Split Learning
ICS sparsifies wireless split-learning features with server-side Grad-CAM scores, cutting communication cost.
Stories per day · 30 days
4 stories, newest first · one card per story
Stories tagged #communication-efficiency
CTP-FL: Common-Trajectory Gradient Prediction for Federated Learning
CTP-FL estimates a shared global gradient path at the same per-round cost as FedAvg-M.
Accelerating Sharded Data Parallelism at Scale with Federated Learning
Hybrid FL+FSDP and FL+HSDP algorithms cut communication overhead in sharded data parallelism, accelerating Llama3.1 8B pre-training on 512 A100 GPUs by up to 8x.
Playing log(N)-Questions over Wikipedia Abstracts: Communication Efficiency Between Paired Frontier Models
Six frontier models play a two-agent log(N)-Questions game; Claude Opus 5 lags with 28/68 wins while the top five are near-tied.