GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond

TL;DR

GauStudio is a modular framework that advances 3D Gaussian Splatting by introducing a hybrid representation and a novel surface reconstruction method, improving scene rendering and mesh quality.

Contribution

It provides a standardized, plug-and-play framework for 3D Gaussian Splatting, introduces a hybrid foreground and background model, and proposes GauS for high-fidelity mesh reconstruction without fine-tuning.

Findings

Reduces artifacts in outdoor scenes

Enhances novel view synthesis quality

Enables high-fidelity mesh reconstruction

Abstract

We present GauStudio, a novel modular framework for modeling 3D Gaussian Splatting (3DGS) to provide standardized, plug-and-play components for users to easily customize and implement a 3DGS pipeline. Supported by our framework, we propose a hybrid Gaussian representation with foreground and skyball background models. Experiments demonstrate this representation reduces artifacts in unbounded outdoor scenes and improves novel view synthesis. Finally, we propose Gaussian Splatting Surface Reconstruction (GauS), a novel render-then-fuse approach for high-fidelity mesh reconstruction from 3DGS inputs without fine-tuning. Overall, our GauStudio framework, hybrid representation, and GauS approach enhance 3DGS modeling and rendering capabilities, enabling higher-quality novel view synthesis and surface reconstruction.