Skip to content
NewA calmer, faster ZeroHour

World in World: Explore the World with World Models

Hugging Face daily papersby Chenxi Song, Yanming Yang, Chi Zhang ()1 min read2 · 1 read
AI summary · glm-5.3-flashSummaries by Vani AI

World in World is a training-free inference-time interface enabling camera-controlled rerendering, long-horizon revisiting, and motion transfer with frozen causal video world models.

The framework converts heterogeneous control evidence into camera- and time-labelled clean visual states that are read through the native self-attention of a frozen causal video model. Evidence includes source-video observations, target-view scene projections, geometry renderings for completing newly exposed regions, and retrieved generated states beyond the rolling cache. A correspondence router combines persistent point identities with geometry for token correspondences, while evidence-wise attention CFG independently regulates each auxiliary channel. The shared interface supports camera-controlled rerendering, long-horizon revisiting, and human-motion transfer without additional training.

Key facts
  • Training-free interface works with frozen causal video world models
  • Correspondence router links persistent point identities and geometry for token matching
  • Evidence-wise attention CFG regulates each auxiliary channel independently
  • Supports rerendering, long-horizon revisiting, and human-motion transfer
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

1 min read at huggingface.co

Autoregressive video world models enable interactive, long-horizon exploration, but flexible control remains challenging. Exploring a source video from new viewpoints requires the generated rollout to remain synchronised with the recorded event, place observed content in the requested view, plausibly complete newly exposed regions, and recover previously generated appearance on revisits.

Hugging Face daily papers

By Chenxi Song, Yanming Yang, Chi Zhang · huggingface.co

Read the full article at Hugging Face daily papers

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.