Transferability of labels between multilens cameras

TL;DR

This paper introduces a method combining phase correlation and refinement to automatically transfer labels across different lenses in multilens cameras, achieving over 90% accuracy in a fast process, expanding applications beyond traditional fields.

Contribution

A novel approach that automates label transfer between lenses in multilens cameras using phase correlation and iterative refinement, improving accuracy and speed.

Findings

Label transfer accuracy exceeds 90% in most cases.

The entire process takes approximately 65 milliseconds.

Enables labeling of invisible objects in the visible spectrum.

Abstract

In this work, a new method for automatically extending Bounding Box (BB) and mask labels across different channels on multilens cameras is presented. For that purpose, the proposed method combines the well known phase correlation method with a refinement process. During the first step, images are aligned by localizing the peak of intensity obtained in the spatial domain after performing the cross correlation process in the frequency domain. The second step consists of obtaining the best possible transformation by using an iterative process maximising the IoU (Intersection over Union) metric. Results show that, by using this method, labels could be transferred across different lens on a camera with an accuracy over 90% in most cases and just by using 65 ms in the whole process. Once the transformations are obtained, artificial RGB images are generated, for labeling them so as to transfer this information into each of the other lens. This work will allow users to use this type of cameras in more fields rather than satellite or medical imagery, giving the chance of labeling even invisible objects in the visible spectrum.