OC-OPD improves on-policy distillation via observation-coordinated supervision
OC-OPD uses reverse and forward KL divergences with a four-observation matrix to coordinate gradients, achieving strong gains in mathematical reasoning and OOD transfer.
Stories per day · 30 days
1 stories, newest first · one card per story