Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstruction

TL;DR

This paper introduces a hybrid 3D scene representation combining Gaussian splatting and textured meshes, improving rendering efficiency for indoor scenes with complex textures while maintaining quality.

Contribution

It proposes a novel hybrid approach that integrates 3D Gaussian splatting with textured meshes, optimizing for efficiency and quality in indoor scene reconstruction.

Findings

Achieves higher FPS with fewer Gaussian primitives.

Maintains comparable rendering quality to existing methods.

Effectively models complex textured indoor scenes.

Abstract

3D Gaussian splatting (3DGS) has demonstrated exceptional performance in image-based 3D reconstruction and real-time rendering. However, regions with complex textures require numerous Gaussians to capture significant color variations accurately, leading to inefficiencies in rendering speed. To address this challenge, we introduce a hybrid representation for indoor scenes that combines 3DGS with textured meshes. Our approach uses textured meshes to handle texture-rich flat areas, while retaining Gaussians to model intricate geometries. The proposed method begins by pruning and refining the extracted mesh to eliminate geometrically complex regions. We then employ a joint optimization for 3DGS and mesh, incorporating a warm-up strategy and transmittance-aware supervision to balance their contributions seamlessly.Extensive experiments demonstrate that the hybrid representation maintains comparable rendering quality and achieves superior frames per second FPS with fewer Gaussian primitives.