Privileged-information design shapes on-policy self-distillation gains
An error-step KL contrast predicted training gains better than a utility score that can leak information.
2 stories, newest first · one card per story
An error-step KL contrast predicted training gains better than a utility score that can leak information.
TokenRhythm released NeoHorse-1-9B, an Apache-2.0 9B model post-trained from Qwen3.5-9B with routing-guided agentic post-training toward recursive self-improvement.
Today 1.6K readers · 2.4K views · 774 reads · all time 189K views