Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction

TL;DR

The paper introduces ADM-GS, a novel appearance decomposition framework for multi-traversal scene reconstruction that improves appearance consistency and fidelity by separating material and illumination effects.

Contribution

It proposes an explicit appearance decomposition method with a neural light field and reflection modeling to handle appearance inconsistencies across traversals.

Findings

Achieves +0.98 dB PSNR improvement over baselines.

Produces more consistent appearance across multiple traversals.

Effective on Argoverse 2 and Waymo datasets.

Abstract

Multi-traversal scene reconstruction is important for high-fidelity autonomous driving simulation and digital twin construction. This task involves integrating multiple sequences captured from the same geographical area at different times. In this context, a primary challenge is the significant appearance inconsistency across traversals caused by varying illumination and environmental conditions, despite the shared underlying geometry. This paper presents ADM-GS (Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction), a framework that applies an explicit appearance decomposition to the static background to alleviate appearance entanglement across traversals. For the static background, we decompose the appearance into traversal-invariant material, representing intrinsic material properties, and traversal-dependent illumination, capturing lighting variations. Specifically, we propose a neural light field that utilizes a frequency-separated hybrid encoding strategy. By incorporating surface normals and explicit reflection vectors, this design separately captures low-frequency diffuse illumination and high-frequency specular reflections. Quantitative evaluations on the Argoverse 2 and Waymo Open datasets demonstrate the effectiveness of ADM-GS. In multi-traversal experiments, our method achieves a +0.98 dB PSNR improvement over existing latent-based baselines while producing more consistent appearance across traversals. Code will be available at https://github.com/IRMVLab/ADM-GS.