Streaming Video Editing with Easy Adaptation
SVEET adapts a bidirectional video diffusion model for real-time streaming edits at 15 FPS on one H100.
SVEET adapts a pretrained bidirectional video diffusion model for autoregressive streaming video editing. An auxiliary branch encodes source frames with temporally independent self-attention and injects those features into backbone blocks, while decoupled training keeps controllability orthogonal to causality. The authors report superior editing quality and 15 FPS on a single H100 without auxiliary acceleration, and they released the code.
40