DEPTH method synthesizes deeper terminal tasks for agents
DEPTH tasks exceed existing datasets in depth and work.
Stories per day · 30 days
2 RSS
Relatedagent-benchmarks1agent-evals1ai-benchmarks1depth1depth-metrics1huggingface1llm-benchmarks1long-horizon-tasks1
3 stories, newest first · one card per story
Stories tagged #terminal-tasks
arXiv study finds synthetic AI tasks lack true depth
94% of synthetic tasks pass within three turns but depth predicts difficulty better than turn count.
Paper finds most long-horizon benchmarks lack depth
Audit reveals 94% of synthetic tasks pass in three turns yet depth predicts difficulty better; authors propose DEPTH method and release 105 harder tasks.