LSA maintains accuracy at ultra-long context via latent sparse attention
LSA clusters keys in learned latent space for subquadratic attention, speeding up layers by 22.7x at 10M tokens while matching full-attention accuracy.
1 stories, newest first · one card per story
LSA clusters keys in learned latent space for subquadratic attention, speeding up layers by 22.7x at 10M tokens while matching full-attention accuracy.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views