VASPO: Self-Distillation with Privileged Value Estimation
VASPO combines privileged self-distillation with PPO, gaining up to 2.59 points over PPO on math benchmarks.
Stories per day · 30 days
3 RSS
2 stories, newest first · one card per story
Stories tagged #vaspo
VASPO: Self-Distillation with Privileged Value Estimation
VASPO blends a privileged self-teacher with PPO, improving math accuracy on Qwen3-4B and OLMo3-7B.