You Can't Prefer Emotions You Don't Sample: Intensity Undershoot in DPO-Tuned LLMs
Study quantifies DPO-tuned LLMs undershooting requested emotional intensity, tracing the gap to candidate-pool extremity rather than conditioning format.
1 stories, newest first · one card per story
Study quantifies DPO-tuned LLMs undershooting requested emotional intensity, tracing the gap to candidate-pool extremity rather than conditioning format.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views