SIMPLE: a four-parameter law predicts LLM inference energy cost from architecture
Across 13 dense LLMs on H100 GPUs the law reaches R2 of 0.969 and 11.97% MAPE, and shows agentic requests cost 13x more energy than non-agentic ones.
Stories per day · 30 days
2 RSS
4 stories, newest first · one card per story
Stories tagged #energy-efficiency
SpikeLite: Lightweight Spiking Neural Networks for Time-Series Forecasting
SpikeLite uses frequency-selective spiking encoding and sparse channel attention for energy-efficient time-series forecasting.
Rethinking Heterogeneous System Disaggregation for Subquadratic Attention
SQD disaggregates LLM inference by quadratic versus subquadratic attention layers, improving energy efficiency up to 56% on heterogeneous systems versus GPU-only baselines.
Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents
NVIDIA claims Vera Rubin NVL72 delivers up to 30x more work per watt, citing OpenRouter data that agentic workloads use 15x more tokens than chat.