Trainable [DUMP] prefix tokens cut interference in retrieval embeddings
The method leaves architecture, pooling, and contrastive loss unchanged and reports gains on retrieval and long-context benchmarks.
Stories per day · 30 days
1 stories, newest first · one card per story
Stories tagged #attention-sink