Non-Line-of-Sight Reconstruction using Efficient Transient Rendering

TL;DR

This paper presents a new method for reconstructing hidden objects around corners using time-resolved light measurements, combining a custom renderer with an optimization framework for accurate shape recovery.

Contribution

It introduces a novel analysis-by-synthesis reconstruction scheme that aligns with physically-based rendering and efficiently handles noisy and complex scenes.

Findings

Successfully reconstructs object geometry from synthetic and real data.

Handles high noise levels and non-diffuse materials effectively.

Produces physically consistent shape reconstructions.

Abstract

Being able to see beyond the direct line of sight is an intriguing prospective and could benefit a wide variety of important applications. Recent work has demonstrated that time-resolved measurements of indirect diffuse light contain valuable information for reconstructing shape and reflectance properties of objects located around a corner. In this paper, we introduce a novel reconstruction scheme that, by design, produces solutions that are consistent with state-of-the-art physically-based rendering. Our method combines an efficient forward model (a custom renderer for time-resolved three-bounce indirect light transport) with an optimization framework to reconstruct object geometry in an analysis-by-synthesis sense. We evaluate our algorithm on a variety of synthetic and experimental input data, and show that it gracefully handles uncooperative scenes with high levels of noise or non-diffuse material reflectance.