SmoothScore measures overconfident claims by LLM research agents
Across 7 systems and 4 datasets, the authors find agents make stronger claims than the cited evidence supports.
2 stories, newest first · one card per story
Across 7 systems and 4 datasets, the authors find agents make stronger claims than the cited evidence supports.
With two of seven assessors adversarial, attack success fell to 21.5-53.1% versus 54.7-77.8% for majority voting.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views