SCSim: A Realistic Spike Cameras Simulator

TL;DR

SCSim is a new, realistic spike camera simulator with a comprehensive noise model that improves the authenticity of synthetic spike streams, facilitating high-speed visual applications and dataset creation.

Contribution

We introduce SCSim, a novel spike camera simulator with a detailed noise model, enhancing realism and simplifying dataset generation for spike-based visual tasks.

Findings

SCSim produces more authentic spike streams than existing simulators.

SCSim effectively generates driving scenarios and spike data autonomously.

The simulator advances high-speed visual applications like reconstruction.

Abstract

Spike cameras, with their exceptional temporal resolution, are revolutionizing high-speed visual applications. Large-scale synthetic datasets have significantly accelerated the development of these cameras, particularly in reconstruction and optical flow. However, current synthetic datasets for spike cameras lack sophistication. Addressing this gap, we introduce SCSim, a novel and more realistic spike camera simulator with a comprehensive noise model. SCSim is adept at autonomously generating driving scenarios and synthesizing corresponding spike streams. To enhance the fidelity of these streams, we've developed a comprehensive noise model tailored to the unique circuitry of spike cameras. Our evaluations demonstrate that SCSim outperforms existing simulation methods in generating authentic spike streams. Crucially, SCSim simplifies the creation of datasets, thereby greatly advancing spike-based visual tasks like reconstruction. Our project refers to https://github.com/Acnext/SCSim.