Active Stereo Without Pattern Projector

TL;DR

This paper introduces a framework for active stereo that uses virtual pattern projection based on sparse depth measurements, enabling passive cameras to achieve active stereo benefits without physical projectors, adaptable to various environments.

Contribution

It presents a novel method to implement active stereo virtually, eliminating the need for physical pattern projectors and expanding applicability in diverse settings.

Findings

Improves stereo and deep network accuracy in indoor and outdoor environments.

Works effectively across long and close-range scenarios.

Enables virtual active stereo without physical pattern projectors.

Abstract

This paper proposes a novel framework integrating the principles of active stereo in standard passive camera systems without a physical pattern projector. We virtually project a pattern over the left and right images according to the sparse measurements obtained from a depth sensor. Any such devices can be seamlessly plugged into our framework, allowing for the deployment of a virtual active stereo setup in any possible environment, overcoming the limitation of pattern projectors, such as limited working range or environmental conditions. Experiments on indoor/outdoor datasets, featuring both long and close-range, support the seamless effectiveness of our approach, boosting the accuracy of both stereo algorithms and deep networks.