3D4D: An Interactive, Editable, 4D World Model via 3D Video Generation

TL;DR

3D4D is a novel interactive framework that creates real-time, user-driven 4D visualizations by integrating WebGL and Supersplat rendering, transforming static inputs into dynamic 4D scenes.

Contribution

It introduces a new framework combining WebGL and Supersplat for interactive 4D visualization, enabling real-time, adaptive exploration of complex environments.

Findings

Real-time 4D scene generation from static inputs

Efficient multi-modal interaction with foveated rendering

Open-source project with accessible code

Abstract

We introduce 3D4D, an interactive 4D visualization framework that integrates WebGL with Supersplat rendering. It transforms static images and text into coherent 4D scenes through four core modules and employs a foveated rendering strategy for efficient, real-time multi-modal interaction. This framework enables adaptive, user-driven exploration of complex 4D environments. The project page and code are available at https://yunhonghe1021.github.io/NOVA/.