EGS-SLAM: RGB-D Gaussian Splatting SLAM with Events

TL;DR

EGS-SLAM introduces a robust RGB-D SLAM framework that fuses event data with traditional inputs to improve tracking and 3D reconstruction under severe motion blur, outperforming existing systems.

Contribution

The paper presents a novel GS-SLAM system that integrates event data with RGB-D inputs, modeling continuous camera trajectories and using learnable functions to enhance robustness and reconstruction quality.

Findings

Outperforms existing GS-SLAM in accuracy and reconstruction quality.

Effectively reduces motion blur effects in challenging scenarios.

Demonstrates robustness on synthetic and real-world datasets.

Abstract

Gaussian Splatting SLAM (GS-SLAM) offers a notable improvement over traditional SLAM methods, enabling photorealistic 3D reconstruction that conventional approaches often struggle to achieve. However, existing GS-SLAM systems perform poorly under persistent and severe motion blur commonly encountered in real-world scenarios, leading to significantly degraded tracking accuracy and compromised 3D reconstruction quality. To address this limitation, we propose EGS-SLAM, a novel GS-SLAM framework that fuses event data with RGB-D inputs to simultaneously reduce motion blur in images and compensate for the sparse and discrete nature of event streams, enabling robust tracking and high-fidelity 3D Gaussian Splatting reconstruction. Specifically, our system explicitly models the camera's continuous trajectory during exposure, supporting event- and blur-aware tracking and mapping on a unified 3D Gaussian Splatting scene. Furthermore, we introduce a learnable camera response function to align the dynamic ranges of events and images, along with a no-event loss to suppress ringing artifacts during reconstruction. We validate our approach on a new dataset comprising synthetic and real-world sequences with significant motion blur. Extensive experimental results demonstrate that EGS-SLAM consistently outperforms existing GS-SLAM systems in both trajectory accuracy and photorealistic 3D Gaussian Splatting reconstruction. The source code will be available at https://github.com/Chensiyu00/EGS-SLAM.