NieR: Normal-Based Lighting Scene Rendering

TL;DR

NieR is a novel rendering framework that improves the realism of lighting in dynamic road scenes by modeling complex light reflections on diverse materials, outperforming existing methods.

Contribution

Introduces NieR, a new framework with LD and HNGD modules for accurate and dynamic lighting scene rendering on diverse materials.

Findings

Outperforms state-of-the-art in visual quality.

Effective in dynamic lighting scenarios.

Demonstrates significant performance improvements.

Abstract

In real-world road scenes, diverse material properties lead to complex light reflection phenomena, making accurate color reproduction crucial for enhancing the realism and safety of simulated driving environments. However, existing methods often struggle to capture the full spectrum of lighting effects, particularly in dynamic scenarios where viewpoint changes induce significant material color variations. To address this challenge, we introduce NieR (Normal-Based Lighting Scene Rendering), a novel framework that takes into account the nuances of light reflection on diverse material surfaces, leading to more precise rendering. To simulate the lighting synthesis process, we present the LD (Light Decomposition) module, which captures the lighting reflection characteristics on surfaces. Furthermore, to address dynamic lighting scenes, we propose the HNGD (Hierarchical Normal Gradient Densification) module to overcome the limitations of sparse Gaussian representation. Specifically, we dynamically adjust the Gaussian density based on normal gradients. Experimental evaluations demonstrate that our method outperforms state-of-the-art (SOTA) methods in terms of visual quality and exhibits significant advantages in performance indicators. Codes are available at https://wanghongsheng01.github.io/NieR/.