On-Policy Distillation with Negative-Policy Rollouts
NP-OPD improves on-policy distillation by using weaker-model rollouts as an explicit negative signal.
44
NP-OPD improves on-policy distillation by using weaker-model rollouts as an explicit negative signal.
Today 523 readers · 579 views · 80 reads · all time 109K views