World Models Should Prioritize the Unification of Physical and Social Dynamics
Xiaoyuan Zhang, Chengdong Ma, Yizhe Huang, Weidong Huang, Siyuan Qi, Song-Chun Zhu, Xue Feng, Yaodong Yang

TL;DR
This paper advocates for integrating physical and social dynamics into unified world models to better capture real-world complexity, emphasizing the importance of holistic AI understanding.
Contribution
It introduces guiding principles and a framework for unifying physical and social predictive capabilities in world models, addressing a key gap in current AI systems.
Findings
Highlights the limitations of current siloed models
Proposes ACE Principles for integration
Outlines a research roadmap for holistic models
Abstract
World models, which explicitly learn environmental dynamics to lay the foundation for planning, reasoning, and decision-making, are rapidly advancing in predicting both physical dynamics and aspects of social behavior, yet predominantly in separate silos. This division results in a systemic failure to model the crucial interplay between physical environments and social constructs, rendering current models fundamentally incapable of adequately addressing the true complexity of real-world systems where physical and social realities are inextricably intertwined. This position paper argues that the systematic, bidirectional unification of physical and social predictive capabilities is the next crucial frontier for world model development. We contend that comprehensive world models must holistically integrate objective physical laws with the subjective, evolving, and context-dependent nature…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
