AutoScaffold builds training-time hints for language-model reinforcement learning
Scaffold-free students beat RL baselines on four tasks, including +7.2 ALFWorld success and +4.0 QA exact match.
Stories per day · 30 days
3 RSS
Relatedcoding-agents1cuda1deepgemm1flashattention1kernel-optimization1language-models1mixture-of-experts1model-training1prime-intellect1reinforcement-learning1rlvr1scaffolding1
10 stories, newest first · one card per story
Stories tagged #gpu-kernels
KernelSeek beats FlashAttention-3 by asking questions, not adding tools
A tool-rich agent stalled at 0.50x after 133 steps; KernelSeek reached 1.13x, then 1.16x and 1.46x on later kernels.
Prime Intellect ships trainable fused Mega MoE kernel for faster training
Self-reported full steps on Qwen3 MoE models were 32% to 34% faster than prime-rl and up to 55% faster than TorchTitan.
2
Academia is for Ambition — Alex Zhang, MIT
MIT's Alex Zhang discusses Recursive Language Models, GPU kernels, and multi-agent harnesses.
KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation
KernelZero-7B beats Claude-4.5-Sonnet and DeepSeek-V4-Pro on CUDA and Triton kernel generation.
Google Deepmind's Dream-RSI helps AI agents improve by “dreaming” about past attempts
Google DeepMind's Dream-RSI improves AI agent search strategies by replaying recorded search histories, cutting attempts and compute across code, math, and GPU kernel tasks.
7
FlashVector: Agent for Hierarchical Model Serving Stack Optimization
FlashVector agent optimizes all layers of Unity's ad-serving stack, delivering up to 2x model-server throughput and 1.98x latency speedup in production.
VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention
VC-Attention is a training-free low-bit attention method for diffusion transformers, achieving 1.46-1.59x kernel speedups on datacenter GPUs with higher fidelity.
NVIDIA Announces CUDA Rust with cuda-oxide (SIMT) and cutile-rs (Tile) for Compile-Time-Safe GPU Kernels
NVIDIA launches CUDA Rust via open-source cuda-oxide (SIMT) and cutile-rs (Tile), bringing compile-time-safe Rust GPU kernels.
6
Import AI 470: No rights for machines; automating environment generation with SPADE; and building better GPU kernels with Hawkeye
METR analysis finds AI accelerating cyber vulnerability discovery, while SPADE self-play environment generation improves Qwen3 reasoning benchmark scores at 30B scale.
3