On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics
Controlled distillation finds KL direction matters more than on-policy versus off-policy rollouts.
1 stories, newest first · one card per story
Controlled distillation finds KL direction matters more than on-policy versus off-policy rollouts.
Today 1K readers · 1.5K views · 1.1K reads · all time 159K views