Δτ-Bench tests agents as tool ecosystems change
The strongest evaluated model or harness reached only 42.3% success on 1,588 tasks across six ecosystem states.
8 stories, newest first · one card per story
The strongest evaluated model or harness reached only 42.3% success on 1,588 tasks across six ecosystem states.
On HotpotQA and LoCoMo it beat MASkills on most categories, with the largest gains on multi-hop questions.
Fixed-Window SSL scored 0.801 utility on 155 cases, above no-Skill, Trace2Skill, and SKILL-KD baselines.
RoboRSI lets a mobile manipulator reuse validated skills, beating baselines by up to 11 points.
UniSkill lets one policy act and propose skill edits using contrastive feedback without extra rollouts.
Skill2Real learns sim-to-real robot manipulation skills via a Proposer-Verifier-Governor loop, achieving 78.75% task completion on real robots without fine-tuning.
Paper introduces skill-space shooting, using foundation model guidance over reusable skills to turn robot failure corrections into autonomous policy improvement.
Paper proposes skill habit formation so agents cache deterministic skills from execution history, fixing 38-74% answer inconsistency and cutting tokens 14-56%.
Today 1.6K readers · 2.4K views · 771 reads · all time 189K views