HiSTEVE 1.0 uses a hierarchical VLA agent for open-world Minecraft
It scores 85.0% on MineStudio Bench and 37.4% average success on OpenHA, and can craft an iron pickaxe from scratch.
17 stories, newest first · one card per story
It scores 85.0% on MineStudio Bench and 37.4% average success on OpenHA, and can craft an iron pickaxe from scratch.
Across 64 benchmarks, Act is explicitly evaluated, while only 5 assess Anticipate and 3 assess Verify.
The benchmark has 360 episodes across 30 indoor scenes, and tests of eight MLLMs found updates and human interaction still hard.
Across 64 benchmarks, only five assess Anticipate and three assess Verify, so both remain largely hidden behind task success.
With a fixed VLA executor, autonomous harness selection reached 51.38% success versus 44.38% without self-evolution.
One hundred twenty runs span 0.8B–27B models, 50–1,600 hours of data, and five world mixtures.
The benchmark uses 600 prompts and 46 dimensions, with object-level measurements instead of only visual-language judgments.
MC-EvoBench tests whether Minecraft agents convert experience into durable capabilities that transfer across reset worlds.
EmbodiedCLBench measures whether embodied agents can recombine basic skills for harder unseen tasks.
Attacca improves long-horizon Minecraft agents to 39-47.5% clean success, up to 7x better on extended tasks.
RobotUse lets robot agents revise physical actions, reaching 45% task success on RoboLab.
RPG improves robot manipulation from 28.6% to 95% success in simulation and succeeds in all 30 physical trials.
GGSD uses game self-play to learn a small set of human-playable motor skills for embodied agents.
ProgressCompass supplies missing context so embodied progress reward models estimate long-task progress more accurately.
RoboFoundry evolves embodied agent systems as policies, lifting GPT-5.5 by 27.8% on EmbodiedBench.
Agent as Policy lets a general-purpose agent drive a physical robot via runtime reasoning and program generation, reaching 100% success on manipulation tasks.
Show-Harness enables VLM agents to control robots via a semantic action interface, achieving zero-shot frontier control and few-GPU-hour adaptation of small VLMs.
Today 1.6K readers · 2.4K views · 775 reads · all time 189K views