Rowhammer bit-flip in Triton slows or corrupts LLM inference
LLVMhammer raised single-GPU latency 4-16% on four models and could cut BERTScore to 25%.
Stories per day · 30 days
3 RSS
7 stories, newest first · one card per story
Stories tagged #triton
SpecFold: Folding Multi-Branch Redundancy for Faster Speculative Decoding in Diffusion Language Models
SpecFold reuses multi-branch computation to speed diffusion-LLM speculative decoding by up to 1.99×.
KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation
KernelZero-7B beats Claude-4.5-Sonnet and DeepSeek-V4-Pro on CUDA and Triton kernel generation.
Block Sparse Attention with Log-Linear Complexity
PISA selects sparse attention blocks with pyramid Top-K routing, reducing complexity to O(N log N).
SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
SAS trains a gated sparse attention selector end-to-end with the language modeling loss, beating distillation-based sparsifiers on reasoning, long-context, and agentic tasks.
Attention Quantization for Tabular Foundation Models
FP8 quantization of attention queries, keys, and values speeds tabular foundation model inference up to 1.7x with no accuracy loss.
SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
SAS trains attention sparsification end-to-end with the language modeling loss, beating sparse attention baselines especially under tight context budgets.