CRiM-GS: Continuous Rigid Motion-Aware Gaussian Splatting from Motion-Blurred Images

TL;DR

CRiM-GS introduces a novel method for reconstructing accurate 3D scenes from motion-blurred images by modeling continuous camera trajectories with neural ODEs, enabling real-time rendering and handling complex motion patterns.

Contribution

It proposes a continuous rigid motion-aware Gaussian Splatting framework that predicts camera trajectories with neural ODEs and compensates for distortions, advancing 3D reconstruction from motion-blurred images.

Findings

Achieves state-of-the-art results on benchmark datasets.

Effectively models complex camera motions and distortions.

Maintains real-time rendering speeds.

Abstract

3D Gaussian Splatting (3DGS) has gained significant attention for their high-quality novel view rendering, motivating research to address real-world challenges. A critical issue is the camera motion blur caused by movement during exposure, which hinders accurate 3D scene reconstruction. In this study, we propose CRiM-GS, a \textbf{C}ontinuous \textbf{Ri}gid \textbf{M}otion-aware \textbf{G}aussian \textbf{S}platting that reconstructs precise 3D scenes from motion-blurred images while maintaining real-time rendering speed. Considering the complex motion patterns inherent in real-world camera movements, we predict continuous camera trajectories using neural ordinary differential equations (ODE). To ensure accurate modeling, we employ rigid body transformations with proper regularization, preserving object shape and size. Additionally, we introduce an adaptive distortion-aware transformation to compensate for potential nonlinear distortions, such as rolling shutter effects, and unpredictable camera movements. By revisiting fundamental camera theory and leveraging advanced neural training techniques, we achieve precise modeling of continuous camera trajectories. Extensive experiments demonstrate state-of-the-art performance both quantitatively and qualitatively on benchmark datasets.