P^2-MOPD accelerates multi-teacher distillation with parameter priors
P^2-MOPD jointly optimizes mixing coefficients and student weights to reach 94.7% recovery in half the steps of MOPD.
Stories per day · 30 days
1 stories, newest first · one card per story
Stories tagged #parameter-merging