ZeroHour

Search: “camera-control”

2 stories in the last 30d

World in World: Explore the World with World Models

World in World is a training-free inference-time interface enabling camera-controlled rerendering, long-horizon revisiting, and motion transfer with frozen causal video world models.

The framework converts heterogeneous control evidence into camera- and time-labelled clean visual states that are read through the native self-attention of a frozen causal video model. Evidence includes source-video observations, target-view scene projections, geometry renderings for completing newly exposed regions, and retrieved generated states beyond the rolling cache. A correspondence router combines persistent point identities with geometry for token correspondences, while evidence-wise attention CFG independently regulates each auxiliary channel. The shared interface supports camera-controlled rerendering, long-horizon revisiting, and human-motion transfer without additional training.

Hugging Face daily papers · 6d agoAI research

AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video

AlayaVista is a camera-controllable streaming video world model that decouples panoramic scene evolution from perspective synthesis, trained on a 1,318-hour 4K dataset.

AlayaVista builds a 360-degree scene prior from a single perspective image, evolves it as a camera-conditioned panoramic latent state, and maps it to perspective video via a latent viewport renderer plus a perspective refiner. Chunk-autoregressive generation and few-step distillation enable efficient streaming. The authors introduce MUGEN, a real-world panoramic video dataset with 1,318 hours of at-least-4K video and rich semantic and geometric annotations.

Hugging Face daily papers · 3d agoAI research