WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
WorldCrafter uses implicit 3D-aware memory to keep video world models consistent during long camera moves.
WorldCrafter is a video world model that stores a camera-queryable implicit 3D-aware memory so generated scenes respect earlier observations across long horizons and changing viewpoints. A jointly trained memory encoder and pose-conditioned readout compress multi-view history into a fixed token set before denoising, without explicit depth matching. Combined with recent temporal context and few-step distillation, it supports streaming exploration from a single image or text prompt. Experiments on static and dynamic scenes report better long-horizon consistency and camera control while keeping visual quality over minute-scale rollouts.
- A memory encoder and pose-conditioned readout produce view-specific tokens.
- No explicit depth correspondences are required.
- Memory is combined with recent context and few-step distillation.
- Streaming exploration starts from one image or a text prompt.
- Gains cover long-horizon consistency and camera-control accuracy.
From the original article
1 min read at huggingface.co
Video world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints. We present WorldCrafter, a video world model that learns a camera-queryable implicit 3D-aware memory for this purpose.
By Wangbo Yu, Kunhao Liu, Wenbo Hu · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.