Direct Nash Optimization aligns language models with general preferences
DNO-Prct iterates on-policy sampling, rating, and contrastive updates to raise length-controlled win rates on AlpacaEval 2.0 for Llama 3.1 8B and Mistral 7B Instruct models.
Stories per day · 30 days
1 RSS
1 stories, newest first · one card per story