BizBench tests long-horizon payment agents on constraint-valid execution
Claude Opus 5 and GPT-6 Sol reach only 64.0% and 61.3% strict success on 50 payment tasks.
3 stories, newest first · one card per story
Claude Opus 5 and GPT-6 Sol reach only 64.0% and 61.3% strict success on 50 payment tasks.
A distilled 9B student gained 9.8 points over the native baseline and cut estimated teacher API cost by 54.8%.
POrchestra lets sub-agents request mid-run harness changes, lifting long-horizon task success by about 9%.
Today 1.4K readers · 2.4K views · 1.9K reads · all time 160K views