InfraRSI harness applies recursive self-improvement to LLM training
On four dense and MoE workloads, the authors report up to 2.75x speedup and mean MFU rising from 17.4% to 30.0%.
Stories per day · 30 days
4 stories, newest first · one card per story
Stories tagged #training-infrastructure
Flattening Every Memory Peak in Long-Context Mixture-of-Experts Training
Four scheduling techniques bound all memory peaks in long-context MoE training, enabling 120B-667B models at 1M-token context with up to 10.4x throughput.
Miles v0.1: Production-Level Post-Training
Radix Ark open-sources Miles v0.1, a full-stack RL post-training framework demonstrated with asynchronous agentic RL on GLM-5.2 744B-A40B across 64 GB300 GPUs.
To keep the AI hacking genie bottled up, try one-way networks
Intuition Machines CEO proposes data diodes and one-way networks to physically prevent frontier AI models from escaping training sandboxes, citing the OpenAI Hugging Face incident.
2