Continually Post-training Small Models via Synthetic Self-distillation
SynthSelf lets small models continually post-train by outsourcing in-distribution rewrites to a slightly larger same-family aligner.
1 stories, newest first · one card per story
SynthSelf lets small models continually post-train by outsourcing in-distribution rewrites to a slightly larger same-family aligner.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views