Knowledge That Is Linear Before Fine-Tuning Generalizes After It
How linearly readable a pretrained fact is strongly predicts whether fine-tuning on it generalizes.
2 stories, newest first · one card per story
How linearly readable a pretrained fact is strongly predicts whether fine-tuning on it generalizes.

SpaceXAI releases Grok 4.7, a new flagship model for coding and agentic tasks, at the same price as Grok 4.6.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views