
Goodfire researcher claims neural nets are more interpretable than thought
Stanford's Chris Potts calls the 26,000-word post a hunch that does not make interpretability easier.
1
4 stories, newest first · one card per story

Stanford's Chris Potts calls the 26,000-word post a hunch that does not make interpretability easier.

Nick Cammarata argues famous polysemantic neurons were misread, claiming most Qwen3-32B neurons have one job.

A Goodfire researcher argues neural networks are already interpretable and superposition was misread.
Transformers superpose next-token distributions from mixed text streams, and fine-tuning can restore that linearity.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views