Performance Characterization of Image Feature Detectors in Relation to the Scene Content Utilizing a Large Image Database

TL;DR

This study evaluates how scene content influences the performance of various image feature detectors using a large, diverse image database, revealing new insights into their behavior under different conditions.

Contribution

It introduces a new framework for classifying scene types that affect detector performance and assesses multiple detectors across a large dataset to understand their behavior better.

Findings

Scene content significantly impacts detector performance.

Certain detectors perform better on specific scene types.

The study provides a comprehensive analysis of detector behavior under various conditions.

Abstract

Selecting the most suitable local invariant feature detector for a particular application has rendered the task of evaluating feature detectors a critical issue in vision research. No state-of-the-art image feature detector works satisfactorily under all types of image transformations. Although the literature offers a variety of comparison works focusing on performance evaluation of image feature detectors under several types of image transformation, the influence of the scene content on the performance of local feature detectors has received little attention so far. This paper aims to bridge this gap with a new framework for determining the type of scenes, which maximize and minimize the performance of detectors in terms of repeatability rate. Several state-of-the-art feature detectors have been assessed utilizing a large database of 12936 images generated by applying uniform light and blur changes to 539 scenes captured from the real world. The results obtained provide new insights into the behaviour of feature detectors.