A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics
A diagnostic study shows fast camera motion causes world-space human trajectory drift and offers a scale correction.
Monocular world-space human recovery methods perform well on existing benchmarks that rarely include fast camera motion. The authors introduce the K-Pop stress test, using broadcast dance videos with large camera motion and dense multi-person choreography. Leading methods produce plausible per-frame meshes, yet world-space trajectories drift because camera and human estimates are recovered at mismatched scales. A closed-form scale correction, combined with physical constraints, removes the drift without retraining and supports choreography modeling, scene editing, and data generation.
- K-Pop stress test uses broadcast dance videos with fast camera motion and dense multi-person choreography.
- Per-frame meshes look plausible, but world-space trajectories drift from stage positions.
- Drift comes from combining self-consistent camera and human estimates at mismatched scales.
- A closed-form one-scale correction removes drift without retraining existing backends.
From the original article
1 min read at huggingface.co
Monocular world-space human recovery methods excel on current benchmarks, but these rarely include fast camera motion. We introduce the K-Pop stress test, broadcast dance videos that combine fast, large camera motion with dense multi-person choreography. Leading methods produce plausible per-frame meshes on these videos, yet their world-space trajectories drift far from the performers' stage positions.
By Hao-Jen Chien, Wei-Lun Chao, Yu-Lun Liu · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.