Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation
Vidu S2 delivers real-time 720p interactive avatar generation plus real-time video editing with style, clothing, character, and background replacement.
Vidu S2 comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. S2-Avatar supports real-time 720p generation, dynamic references updatable at any moment, and stronger instruction following such as dancing, while S2-Editing performs real-time style rendering, clothing replacement, character replacement, and background replacement. The work also explores real-time spatial video generation for both models, reports outperforming all baselines, and offers a playable online demo at vidu.com.
- Real-time 720p interactive avatar video generation
- Real-time editing supports style, clothing, character, and background changes
- Extends both models to real-time spatial video generation
From the original article
1 min read at huggingface.co
We present Vidu S2, which comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. Moreover, we explore the feasibility of real-time spatial video generation for both Vidu S2-Avatar and Vidu S2-Editing.
By Jintao Zhang, Kai Jiang, Jintao Chen · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.