GaussianFluent: Gaussian Simulation for Dynamic Scenes with Mixed Materials

TL;DR

GaussianFluent is a novel framework that combines Gaussian-based volumetric interior synthesis with high-speed brittle fracture simulation, enabling realistic, real-time rendering of complex dynamic scenes with mixed materials.

Contribution

It introduces a unified approach for realistic interior synthesis and fracture-aware simulation of Gaussian representations, addressing key limitations of prior methods.

Findings

Enables photo-realistic interior rendering with coherent textures.

Supports high-speed brittle fracture simulation for complex objects.

Achieves real-time performance in dynamic scene rendering.

Abstract

3D Gaussian Splatting (3DGS) has emerged as a prominent 3D representation for high-fidelity and real-time rendering. Prior work has coupled physics simulation with Gaussians, but predominantly targets soft, deformable materials, leaving brittle fracture largely unresolved. This stems from two key obstacles: the lack of volumetric interiors with coherent textures in GS representation, and the absence of fracture-aware simulation methods for Gaussians. To address these challenges, we introduce GaussianFluent, a unified framework for realistic simulation and rendering of dynamic object states. First, it synthesizes photorealistic interiors by densifying internal Gaussians guided by generative models. Second, it integrates an optimized Continuum Damage Material Point Method (CD-MPM) to enable brittle fracture simulation at remarkably high speed. Our approach handles complex scenarios including mixed-material objects and multi-stage fracture propagation, achieving results infeasible with previous methods. Experiments clearly demonstrate GaussianFluent's capability for photo-realistic, real-time rendering with structurally consistent interiors, highlighting its potential for downstream application, such as VR and Robotics.