VidaForge: Open Research Infrastructure for Video Pretraining Data Recipes
VidaForge releases open infrastructure and VIDAFORGE-3M (3.14M clips, 6,475 hours) linking video pretraining data recipes to downstream model performance.
VidaForge is an open research infrastructure that represents a video pretraining data recipe as an executable five-stage workflow from raw videos to training datasets. The team compares data recipes with different coverage and quality during early from-scratch pretraining of Wan 2.1 and V-JEPA 2.1, finding that broader-coverage recipes achieve the highest downstream benchmark scores while loss-based evaluation favors different recipes. They also release VIDAFORGE-3M, containing 3.14 million scene-level clips totaling 6,475 hours with fine-grained annotations and curation signals for video data-recipe research.
- Represents video data recipes as executable five-stage workflows with reproducible sample provenance
- Broader-coverage recipes achieve the highest downstream scores in Wan 2.1 and V-JEPA 2.1 pretraining
- Releases VIDAFORGE-3M: 3.14M scene-level clips, 6,475 hours, with annotations and curation signals
- Products
- VidaForgeVIDAFORGE-3M
- AI models
- Wan 2.1V-JEPA 2.1
From the original article
1 min read at huggingface.co
Video foundation models increasingly rely on large-scale pretraining data, yet the end-to-end data pipelines behind them remain largely closed and difficult to inspect or reuse. Researchers seeking to understand how video data recipes affect model pretraining often need to build substantial infrastructure before testing even a focused hypothesis.
By Yan Ma, Jiadi Su, Zhulin Hu · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.