ZHA achieves subquadratic sparse attention for long-context LLMs
ZHA uses hierarchical tree indexers for subquadratic attention scaling beyond 1M tokens with maintained performance.
1 stories, newest first · one card per story
ZHA uses hierarchical tree indexers for subquadratic attention scaling beyond 1M tokens with maintained performance.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views