AI agents build 3D scenes from photos but have no idea if they got it right
LEGO-Anything has coding agents write Blender scenes from one photo, but they cannot reliably judge geometric accuracy.
LEGO-Anything, called Image-to-Code, has a coding agent iteratively write and revise an executable Blender program from a single photo so the scene can be edited and queried. LEGO-Bench scores 208 images from 104 simulator scenes and 443 assets on validity, geometric accuracy, and visual similarity. GPT-6 Astra reached 53.4 percent indoors and 39.6 percent outdoors, versus about 15 percent for weaker GPT setups; extra reasoning lifted Astra from 32.3 to 61.8 percent on an office subset. Models judged geometry near chance, while the training-free LEGO-Plugin, which substitutes measurements for self-assessment, improved weaker agents by up to 62.7 percentage points.
- Image-to-Code agents iteratively write, run, and revise Blender code from one photo.
- LEGO-Bench covers 208 images from 104 scenes and 443 registered assets.
- GPT-6 Astra scored 53.4 percent indoors and 39.6 percent outdoors.
- Geometric self-assessment landed near chance, so agents cannot judge their own scenes.
- Training-free LEGO-Plugin uses measurements and boosted weaker agents by up to 62.7 points.
- Products
- BlenderClaude CodeCodex
- Organizations
- UnityWorld LabsGoogle DeepMind
From the original article
4 min read at the-decoder.com
A new approach called LEGO-Anything turns single photos into editable Blender code for 3D scenes. GPT-6 Astra leads the accompanying benchmark with up to 53 percent reconstruction accuracy. The biggest weakness across all tested agents is that they can't judge their own geometric accuracy any better than a coin flip.
By Jonathan Kemper · the-decoder.com
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.