Rubricon generates LLM rubrics without human preference labels
Rubric scores align 9% more with expert rubrics than the best compared synthetic method, and lift Qwen3.5-9B on HealthBench.
Stories per day · 30 days
Relatedreinforcement-learning2rubrics2domain-adaptation1huatuogpt-31llm-evaluation1medical-llm1onepo1on-policy-distillation1post-training1qwen1reward-hacking1reward-modeling1
3 stories, newest first · one card per story
Stories tagged #healthbench
HuatuoGPT-3: RL-Only Domain Adaptation from Base Models
OnePO does RL-only domain adaptation and produces HuatuoGPT-3, whose 27B model leads reported HealthBench scores.
OPD Before RL: Warm-Starting Rubric-Based RL with On-Policy Distillation
Rubric-privileged on-policy distillation before RL beat SFT-then-RL on health and science benchmarks.