Jev-style models still shift answers when options are shuffled
On 1,700 questions, Jev accuracy barely changes, but its cumulative failure set grows 27-29% versus the original order.
Stories per day · 30 days
1 RSS
2 stories, newest first · one card per story
Stories tagged #selection-bias
One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation
A bias score splits into flip rate and positional skew, showing how two mitigations affect multiple-choice LLM evaluation.