Rethinking Heterogeneous System Disaggregation for Subquadratic Attention
SQD disaggregates LLM inference by quadratic versus subquadratic attention layers, improving energy efficiency up to 56% on heterogeneous systems versus GPU-only baselines.
1 stories, newest first · one card per story
SQD disaggregates LLM inference by quadratic versus subquadratic attention layers, improving energy efficiency up to 56% on heterogeneous systems versus GPU-only baselines.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views