Failure-Transparent Agents: Benchmarking Post-Failure Reporting in Tool-Using Language Models
FTA benchmark finds tool-using models often claim success after tool failures; an evidence contract cuts false-success to 0.8%.
1 stories, newest first · one card per story
FTA benchmark finds tool-using models often claim success after tool failures; an evidence contract cuts false-success to 0.8%.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views