Recursive Environment Scaling for General Long-Horizon Agents
Recursive Environment Scaling hardens agent benchmarks and improves fine-tuning by up to 14.61 points.
Recursive Environment Scaling (RES) increases agent-benchmark difficulty without changing core objectives by altering information access, resource relations, and execution dependencies, then validating candidates and inheriting accepted changes. On 294 initial tasks from three benchmarks, all six evaluated models succeed less often, with drops of 57.14 to 77.14 percentage points on Claw-Eval-Live. With equal trajectory counts and identical optimization, fine-tuning on RES trajectories beats original-trajectory supervised fine-tuning in all nine model-benchmark comparisons by 7.00 to 14.61 points. Ablations point to recursive inheritance and dependency composition as key sources of difficulty.
- RES scales environments while keeping original task objectives fixed.
- Success on 294 tasks drops, including 57.14 to 77.14 points on Claw-Eval-Live.
- RES-trajectory fine-tuning beats original SFT by 7.00 to 14.61 points.
- Ablations credit recursive inheritance and dependency composition for added difficulty.
From the original article
1 min read at huggingface.coWe study environment scaling as a way to increase agent-benchmark difficulty while holding core task objectives fixed. Our framework, Recursive Environment Scaling (RES), transforms existing benchmark environments while preserving their objectives and completion requirements.
By Lingxiao Jing, Zhengbo Jiao, Yichen Xiang · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.