TrackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations
TrackEverything tracks all visible 3D points in videos beyond 1,000 frames within 40 GB by de-duplicating scene geometry.
TrackEverything represents videos as persistent 3D scene tracks in world coordinates so cost scales with unique geometry rather than duration. It de-duplicates co-located tracks at sliding-window boundaries, classifies static versus dynamic points, and samples features in the scene cloud with 3D WAFT instead of 4D correlation volumes. The authors report tracking all visible points in videos longer than 1,000 frames within 40 GB of GPU memory. On TAPVid-3D it outperforms open-source all-frame dense 3D trackers by more than 20% APD on short clips.
44