HLA: Expressive Hybrid Linear Attention via Chunk-Wise Dynamic Mixing
Hybrid Linear Attention adds query-dependent chunk routing to Gated DeltaNet, lifting long-context scores on Qwen3.5.
Stories per day · 30 days
3 RSS
3 stories, newest first · one card per story
Stories tagged #longbench
Periscope: Extending Frozen Language Models Beyond Their Context Window
Periscope lets frozen models answer million-token contexts via a training-free chunked evidence map.
The Sirens' Song: When Proximal Background Context Overshadows Distant Evidence
LYRA realigns long-context attention so distant task evidence is not drowned out by proximal background.