Runway previews real-time interactive AI world models
Runway is previewing real-time world models, including GWM Worlds 2 at 720p and 24 fps, with a sub-100 ms first-frame target and no release date.
Runway is previewing research on real-time, interactive AI video built around its General World Model line. The Decoder reported on Sept. 20, 2026, that GWM-1, introduced in December 2025 and based on Gen-4.5, generates frames from camera, robot, or audio inputs, aims for a fast first frame and lower GPU cost, and trains on its own outputs to limit compounding visual errors. That report also said an Nvidia preview on Vera Rubin targets a first frame in under 100 milliseconds, with no release date, and cited Decart's MirageLSD and DeepMind's Genie 3. Latent Space reported on Sept. 25 that GWM Worlds 2 streams 720p video at 24 fps with 48 kHz audio, and that WorldPrompt fixes a first frame and timestamped live actions via fine-tuning, autoregressive diffusion, and distillation. The sources do not contradict on figures, but they use different product names and technical details, so it is not stated whether Worlds 2 is the same Nvidia preview; both still flag error accumulation, while only Latent Space gives the valuation and names Odyssey-2 Pro and World Labs RTFM.
- GWM-1, Runway's first General World Model, was introduced in December 2025, builds on Gen-4.5, and generates video frame by frame from camera movements, robot commands, or audio.
- Each new segment uses prior frames as context, so small errors can compound; Runway trains models on their own outputs to encourage self-correction.
- A research preview developed with Nvidia runs on the Vera Rubin platform and targets a first frame in under 100 milliseconds; no availability timeline was announced.
- GWM Worlds 2 streams interactive 720p video at 24 fps with 48 kHz audio.
- WorldPrompt locks a first frame and accepts timestamped actions, including live prompts, without a game-style scripting layer.
- Runway fine-tunes the base model, converts bidirectional diffusion to autoregressive generation, and uses distillation to cut denoising steps.
- Error accumulation and GPU or context-memory limits remain open issues.
- Runway was valued at $5.3 billion after raising $315 million; peers named include Decart MirageLSD, DeepMind Genie 3, Odyssey-2 Pro, and World Labs RTFM.
Coverage timelineoldest first · each row is one article
- · 6d agoRunway wants to turn AI video generation into a live stream you control in real time
The Decoder· 38
Runway previews research on real-time AI video generation using its GWM-1 world model to cut wait times and GPU costs.
- · 2d agoRunway’s WorldPrompt and the Engineering of Real-Time Worlds
Latent Space· 52
Runway details WorldPrompt in GWM Worlds 2, a real-time 720p interactive world model at 24 fps.