WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
WorldCrafter is a video world model with implicit 3D-aware memory enabling long-horizon consistent scene exploration from a single image or prompt.
WorldCrafter learns a camera-queryable implicit 3D-aware memory so video generation respects prior observations over long horizons and across viewpoints. A memory encoder and pose-conditioned readout compress multi-view evidence into view-specific tokens before denoising, without explicit depth-based correspondences. Combined with temporal context and few-step distillation, it enables streaming scene exploration from a single input image or text prompt, with substantial gains in long-horizon consistency and camera-control accuracy during minute-scale exploration.
- Camera-queryable implicit 3D-aware memory conditions the video generator on history.
- Viewpoint shapes how multi-view evidence is compressed into a fixed token budget.
- Enables minute-scale streaming exploration from one image or text prompt.
From the original article
1 min read at arxiv.orgVideo world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints. We present WorldCrafter, a video world model that learns a camera-queryable implicit 3D-aware memory for this purpose.
By Wangbo Yu · arxiv.org
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.