Monte Carlo Path Tracing and Statistical Event Detection for Event Camera Simulation

TL;DR

This paper introduces a physically accurate event camera simulation system using Monte Carlo path tracing with adaptive sampling based on statistical hypothesis testing, significantly improving efficiency and realism for computer vision research.

Contribution

It presents the first adaptive Monte Carlo path tracing method for simulating event cameras, utilizing statistical hypothesis testing to optimize sampling and improve simulation speed and accuracy.

Findings

Achieves significant speed-up over uniform sampling methods.

Models logarithmic luminance differences using normal distribution.

Provides a physically accurate simulation of event camera behavior.

Abstract

This paper presents a novel event camera simulation system fully based on physically based Monte Carlo path tracing with adaptive path sampling. The adaptive sampling performed in the proposed method is based on a statistical technique, hypothesis testing for the hypothesis whether the difference of logarithmic luminances at two distant periods is significantly larger than a predefined event threshold. To this end, our rendering system collects logarithmic luminances rather than raw luminance in contrast to the conventional rendering system imitating conventional RGB cameras. Then, based on the central limit theorem, we reasonably assume that the distribution of the population mean of logarithmic luminance can be modeled as a normal distribution, allowing us to model the distribution of the difference of logarithmic luminance as a normal distribution. Then, using Student's t-test, we can test the hypothesis and determine whether to discard the null hypothesis for event non-occurrence. When we sample a sufficiently large number of path samples to satisfy the central limit theorem and obtain a clean set of events, our method achieves significant speed up compared to a simple approach of sampling paths uniformly at every pixel. To our knowledge, we are the first to simulate the behavior of event cameras in a physically accurate manner using an adaptive sampling technique in Monte Carlo path tracing, and we believe this study will contribute to the development of computer vision applications using event cameras.