Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs
Transformers superpose next-token distributions from mixed text streams, and fine-tuning can restore that linearity.
1 stories, newest first · one card per story
Transformers superpose next-token distributions from mixed text streams, and fine-tuning can restore that linearity.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views