GS-DMSR: Dynamic Sensitive Multi-scale Manifold Enhancement for Accelerated High-Quality 3D Gaussian Splatting

TL;DR

GS-DMSR introduces an adaptive, multi-scale approach for high-quality 3D dynamic scene reconstruction, significantly improving convergence speed and rendering quality while reducing storage and training time.

Contribution

It proposes a novel adaptive gradient focusing mechanism and a multi-scale manifold enhancement module for efficient dynamic 3D scene modeling.

Findings

Achieves up to 96 FPS on synthetic datasets

Reduces storage overhead and training time

Enhances modeling efficiency for complex deformations

Abstract

In the field of 3D dynamic scene reconstruction, how to balance model convergence rate and rendering quality has long been a critical challenge that urgently needs to be addressed, particularly in high-precision modeling of scenes with complex dynamic motions. To tackle this issue, this study proposes the GS-DMSR method. By quantitatively analyzing the dynamic evolution process of Gaussian attributes, this mechanism achieves adaptive gradient focusing, enabling it to dynamically identify significant differences in the motion states of Gaussian models. It then applies differentiated optimization strategies to Gaussian models with varying degrees of significance, thereby significantly improving the model convergence rate. Additionally, this research integrates a multi-scale manifold enhancement module, which leverages the collaborative optimization of an implicit nonlinear decoder and an explicit deformation field to enhance the modeling efficiency for complex deformation scenes. Experimental results demonstrate that this method achieves a frame rate of up to 96 FPS on synthetic datasets, while effectively reducing both storage overhead and training time.Our code and data are available at https://anonymous.4open.science/r/GS-DMSR-2212.