WorldAuditBench: Interactive 3D World Auditing with Multimodal Agents
WorldAuditBench tests multimodal agents at finding 3D-world anomalies; frontier models reach 6.6–42.3% versus humans at 83.4%.
WorldAuditBench is a benchmark for auditing interactive 3D worlds for anomalies such as floating objects, traversable walls, and scene-inconsistent objects. It includes 213 tasks across 13 environments built with Unreal Engine 5 and Three.js, covering five anomaly families. Five frontier models were tested under a fixed exploration budget in two setups: VLA exploration followed by VLM identification, and an end-to-end VLM agent. Success rates ranged from 6.6% to 42.3%, well below human performance of 83.4%.
32