Learning Continuous Rotation Canonicalization with Radial Beam Sampling

TL;DR

This paper introduces BIC, a radial beam sampling method for continuous rotation canonicalization, enabling rotation-invariant vision pipelines by predicting precise rotation angles of images.

Contribution

It presents a novel radial beam sampling strategy and a radial kernel-based model for continuous rotation angle regression and canonicalization of images.

Findings

Accurately predicts continuous rotation angles on multiple datasets.

Enables rotation-invariant vision pipelines as a pre-processing step.

Outperforms existing methods in rotation angle estimation.

Abstract

Nearly all state of the art vision models are sensitive to image rotations. Existing methods often compensate for missing inductive biases by using augmented training data to learn pseudo-invariances. Alongside the resource demanding data inflation process, predictions often poorly generalize. The inductive biases inherent to convolutional neural networks allow for translation equivariance through kernels acting parallely to the horizontal and vertical axes of the pixel grid. This inductive bias, however, does not allow for rotation equivariance. We propose a radial beam sampling strategy along with radial kernels operating on these beams to inherently incorporate center-rotation covariance. Together with an angle distance loss, we present a radial beam-based image canonicalization model, short BIC. Our model allows for maximal continuous angle regression and canonicalizes arbitrary center-rotated input images. As a pre-processing model, this enables rotation-invariant vision pipelines with model-agnostic rotation-sensitive downstream predictions. We show that our end-to-end trained angle regressor is able to predict continuous rotation angles on several vision datasets, i.e. FashionMNIST, CIFAR10, COIL100, and LFW.