Paper finds most long-horizon benchmarks lack depth
Audit reveals 94% of synthetic tasks pass in three turns yet depth predicts difficulty better; authors propose DEPTH method and release 105 harder tasks.
1 stories, newest first · one card per story
Audit reveals 94% of synthetic tasks pass in three turns yet depth predicts difficulty better; authors propose DEPTH method and release 105 harder tasks.
Today 1.1K readers · 1.5K views · 474 reads · all time 184K views