InstantHMR recovers 3D human meshes in real time on phones
A Galaxy S23 NPU produces a 6,890-vertex mesh in 5.5 ms, with 40.0 mm PA-MPJPE on 3DPW.
27 stories, newest first · one card per story
A Galaxy S23 NPU produces a 6,890-vertex mesh in 5.5 ms, with 40.0 mm PA-MPJPE on 3DPW.
On CHARM's test set it lowers Chamfer distance by 44% and card-orientation error by more than half, while running 33 times faster.
Training covers 12 camera motions and 88 trajectories, including full 360-degree orbits, with surface-normal conditioning from reference views.
CinemaBench covers 150 Blender scenes, 750 text-directed tasks, and 60 reference videos.
Hierarchical planners compile terrain ahead of the player while one world record restores prior visits and edits.
Point supervision on VPM-Data and VP-WorldBench improves video fidelity, 3D motion, and robot manipulation success.
Evaluations on 100 object and 20 scene tasks report gains on four perceptual metrics.
On OmniCaT, reported trajectory error falls 28–47% and collisions 65.8% versus retrained GenDoP.
MAMHOI factorizes scene-aware human-object interaction through affordances, reducing penetration without paired scene data.
SpaceCast-Bench tests predictive spatial reasoning; the best of 21 models scores 58.0% versus 87.2% for humans.
MAMHOI factorizes scene-aware human-object interaction generation through motion affordances without paired scene data.
SpaceCast-Bench finds VLMs weak at predictive spatial reasoning; the best model scores 58 percent versus 87.2 percent for humans.
GPD distills routed 3D geometry into an RGB-only VLM, lifting a 4B model to 57.1 on VSI-Bench.
Pumpire benchmarks point-pair metric distance accuracy for image and video 3D foundation models.
DepthWorld jointly predicts multi-view RGB and metric depth for robot manipulation from calibrated 3D data.
CADFather coordinates tools and a vision-language agent to reconstruct editable CAD programs from 3D meshes.
NAMVIS generates consistent multi-view images with geometry-conditioned autoregression, beating diffusion baselines and running over 3x faster.
Magic-W0 jointly models structured 3D world transitions and robot actions, leading compared world-action models.
PointWAM forecasts 3D scene and hand trajectories, lifting dexterous robot success on DexJoCo tasks.
GenCine lets artists jointly control 3D camera and object motion in video via guidance maps on a Wan model.
4Director controls video world models using rigid meshes and per-frame transforms for consistent camera and object motion.
World Observer jointly generates an actor view and panoramic observers so video world models preserve out-of-view object dynamics.
WorldAuditBench tests multimodal agents at finding 3D-world anomalies; frontier models reach 6.6–42.3% versus humans at 83.4%.
WorldAuditBench shows multimodal agents trail humans when auditing anomalies in interactive 3D worlds.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views