Runway’s WorldPrompt and the Engineering of Real-Time Worlds
Runway details WorldPrompt in GWM Worlds 2, a real-time 720p interactive world model at 24 fps.
Runway's research preview GWM Worlds 2 turns its audio-video model into a real-time interactive simulation streamed at 720p and 24 fps with 48 kHz audio. WorldPrompt lets users lock a first frame and issue timestamped actions, including live prompts, without a game-style scripting layer. Runway fine-tunes the base model, converts bidirectional diffusion to autoregressive generation, and uses distillation to cut denoising steps for real-time playback. Executives cite error accumulation and context/memory limits; competitors discussed include DeepMind Genie 3, Odyssey-2 Pro, and World Labs RTFM. Runway was valued at $5.3 billion after raising $315 million.
- GWM Worlds 2 streams interactive 720p video at 24 fps with 48 kHz audio.
- WorldPrompt fixes a first frame and timestamped actions that can be prompted in real time.
- Runway fine-tunes for WorldPrompt, post-trains autoregressive diffusion, then distills for speed.
- Error accumulation and GPU-memory limits remain; Runway was valued at $5.3 billion after a $315 million raise.
- Organizations
- RunwayGoogle DeepMindWorld LabsOdyssey
From the original article
14 min read at latent.space
GWM Worlds 2 uses persistent context and timed actions to steer a world model generating video and audio in real time.
By Richard MacManus · latent.space
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.