DeRainGS: Gaussian Splatting for Enhanced Scene Reconstruction in Rainy Environments

TL;DR

This paper introduces DeRainGS, a novel 3D Gaussian Splatting method designed for improved scene reconstruction in rainy environments, supported by a new dataset and extensive experiments showing superior performance.

Contribution

The paper presents the first 3D Gaussian Splatting approach specifically tailored for rainy conditions and introduces the HydroViews dataset for benchmarking.

Findings

DeRainGS outperforms existing methods in rainy scene reconstruction.

HydroViews dataset includes diverse synthesized and real-world rainy scenes.

The method demonstrates robustness across various rain intensities.

Abstract

Reconstruction under adverse rainy conditions poses significant challenges due to reduced visibility and the distortion of visual perception. These conditions can severely impair the quality of geometric maps, which is essential for applications ranging from autonomous planning to environmental monitoring. In response to these challenges, this study introduces the novel task of 3D Reconstruction in Rainy Environments (3DRRE), specifically designed to address the complexities of reconstructing 3D scenes under rainy conditions. To benchmark this task, we construct the HydroViews dataset that comprises a diverse collection of both synthesized and real-world scene images characterized by various intensities of rain streaks and raindrops. Furthermore, we propose DeRainGS, the first 3DGS method tailored for reconstruction in adverse rainy environments. Extensive experiments across a wide range of rain scenarios demonstrate that our method delivers state-of-the-art performance, remarkably outperforming existing occlusion-free methods.