Privileged-information design shapes on-policy self-distillation gains
An error-step KL contrast predicted training gains better than a utility score that can leak information.
1 stories, newest first · one card per story
An error-step KL contrast predicted training gains better than a utility score that can leak information.
Today 1.6K readers · 2.4K views · 774 reads · all time 189K views