JEPA-Anything: Learning Predictive Models across Different Worlds
Researchers present JEPA-Anything, a domain-agnostic world-modeling framework improving prediction across vision, biology, control, molecular dynamics, and weather.
JEPA-Anything extends joint-embedding predictive architectures with orthogonal predictive factorization, decomposing latent targets into complementary factors learned through dedicated pathways. It was evaluated across seven domains, including 10 matched dynamics tasks, forecasting of over 1,000 clinical events, and 100-step molecular rollouts across four systems. Against matched JEPA baselines it improves metrics on all 10 dynamics tasks and cuts single-intervention prediction error on Interventional Pong by 34.8%. A factor-nominated biological intervention received experimental support in cell co-cultures, patient-derived organoids, tumor fragments, and mice.