Zyphra introduces Hierarchical Attention for subquadratic attention
The available text names ZHA but gives no architecture, benchmarks, or release details.
Stories per day · 30 days
1 RSS
2 stories, newest first · one card per story
Stories tagged #subquadratic-attention
Rethinking Heterogeneous System Disaggregation for Subquadratic Attention
SQD disaggregates LLM inference by quadratic versus subquadratic attention layers, improving energy efficiency up to 56% on heterogeneous systems versus GPU-only baselines.