PORT reweights tokens to align models on noisy preferences
The method uses token log-probability CDFs as a forward-only proxy and beats sequence-level baselines under label noise.
2 stories, newest first · one card per story
The method uses token log-probability CDFs as a forward-only proxy and beats sequence-level baselines under label noise.
PLC-DPO corrects noisy preference labels during DPO by routing each pair as clean, flip, or tie using calibrated policy-reference margins.
Today 1.6K readers · 2.5K views · 777 reads · all time 189K views