From two rolling shutters to one global shutter

TL;DR

This paper proposes a simple, cost-effective camera setup with two cameras having different rolling shutter directions to effectively undo rolling shutter distortions in images caused by camera motion.

Contribution

It introduces a novel two-camera configuration that enables correction of rolling shutter distortions using minimal point correspondences, with derived geometric equations and an efficient solution method.

Findings

Successfully removes large rolling shutter distortions in synthetic and real images.

Does not rely on specific scene structures for distortion correction.

Offers a practical and easy-to-implement solution for rolling shutter correction.

Abstract

Most consumer cameras are equipped with electronic rolling shutter, leading to image distortions when the camera moves during image capture. We explore a surprisingly simple camera configuration that makes it possible to undo the rolling shutter distortion: two cameras mounted to have different rolling shutter directions. Such a setup is easy and cheap to build and it possesses the geometric constraints needed to correct rolling shutter distortion using only a sparse set of point correspondences between the two images. We derive equations that describe the underlying geometry for general and special motions and present an efficient method for finding their solutions. Our synthetic and real experiments demonstrate that our approach is able to remove large rolling shutter distortions of all types without relying on any specific scene structure.