Abstention and Noise Filtering: Two Missing Primitives of Softmax Attention
Gating softmax attention supplies abstention and noise filtering, with filtering gains growing from 10M to 350M models.
1 stories, newest first · one card per story
Gating softmax attention supplies abstention and noise filtering, with filtering gains growing from 10M to 350M models.
Today 1.6K readers · 2.5K views · 785 reads · all time 189K views