Coupled Calibration and Learning: Mitigating Teacher Bias in LLM Distillation without Target-Domain Reward Feedback
CCL couples teacher calibration with student updates via token-level branching, provably removing teacher bias in LLM distillation.
1 stories, newest first · one card per story
CCL couples teacher calibration with student updates via token-level branching, provably removing teacher bias in LLM distillation.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views