ATEST adapts LLM test-time sampling to live GPU energy
On four A100 datasets, ATEST-Online stayed inside the energy budget and tied or led accuracy as load rose.
Stories per day · 30 days
3 RSS
2 stories, newest first · one card per story
Stories tagged #gpu-energy
Sample Count Is Not Enough: Candidate-Generation Strategy Shapes the Energy and Performance of LLM Test-Time Scaling
Study shows LLM test-time scaling cost depends on generation schedule: eight serial A100 calls use ~4.7x more GPU energy than one batched call.