3D4D: An Interactive, Editable, 4D World Model via 3D Video Generation
Yunhong He, Zhengqing Yuan, Zhengzhong Tu, Yanfang Ye, Lichao Sun

TL;DR
3D4D is a novel interactive framework that creates real-time, user-driven 4D visualizations by integrating WebGL and Supersplat rendering, transforming static inputs into dynamic 4D scenes.
Contribution
It introduces a new framework combining WebGL and Supersplat for interactive 4D visualization, enabling real-time, adaptive exploration of complex environments.
Findings
Real-time 4D scene generation from static inputs
Efficient multi-modal interaction with foveated rendering
Open-source project with accessible code
Abstract
We introduce 3D4D, an interactive 4D visualization framework that integrates WebGL with Supersplat rendering. It transforms static images and text into coherent 4D scenes through four core modules and employs a foveated rendering strategy for efficient, real-time multi-modal interaction. This framework enables adaptive, user-driven exploration of complex 4D environments. The project page and code are available at https://yunhonghe1021.github.io/NOVA/.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsInteractive and Immersive Displays · Computer Graphics and Visualization Techniques · Human Motion and Animation
