Bio-inspired Polarization Event Camera

TL;DR

This paper introduces a bio-inspired polarization camera that captures high dynamic range, asynchronous polarization data with sub-millisecond latency, enabling advanced imaging of fast-changing scenes and biological tissues.

Contribution

The authors developed a novel stomatopod-inspired polarization sensor that surpasses existing limitations in dynamic range and temporal resolution, integrating both intensity and polarization change detection.

Findings

Captures polarization data with sub-millisecond latency.

Operates over a million-fold illumination range.

Effectively images high-speed HDR polarization scenes.

Abstract

The stomatopod (mantis shrimp) visual system has recently provided a blueprint for the design of paradigm-shifting polarization and multispectral imaging sensors, enabling solutions to challenging medical and remote sensing problems. However, these bioinspired sensors lack the high dynamic range (HDR) and asynchronous polarization vision capabilities of the stomatopod visual system, limiting temporal resolution to \~12 ms and dynamic range to \~ 72 dB. Here we present a novel stomatopod-inspired polarization camera which mimics the sustained and transient biological visual pathways to save power and sample data beyond the maximum Nyquist frame rate. This bio-inspired sensor simultaneously captures both synchronous intensity frames and asynchronous polarization brightness change information with sub-millisecond latencies over a million-fold range of illumination. Our PDAVIS camera is comprised of 346x260 pixels, organized in 2-by-2 macropixels, which filter the incoming light with four linear polarization filters offset by 45 degrees. Polarization information is reconstructed using both low cost and latency event-based algorithms and more accurate but slower deep neural networks. Our sensor is used to image HDR polarization scenes which vary at high speeds and to observe dynamical properties of single collagen fibers in bovine tendon under rapid cyclical loads