Stratified Sparse Attention narrows the sparse-to-dense gap
On Ministral-3-8B at 50x sparsity, SSA lifts RULER-HARD from 63.8% to 69.3% at 128K.
50
On Ministral-3-8B at 50x sparsity, SSA lifts RULER-HARD from 63.8% to 69.3% at 128K.
Entities are extracted by the model from each article. First seen , last mentioned . Watching keeps it in this browser only (no account); the watchlist page and dashboard alerts use it.
Today 256 readers · 278 views · 20 reads · all time 108K views