Feedback-driven object detection and iterative model improvement

TL;DR

This paper introduces an open-source, interactive platform for semi-automatic object detection annotation that significantly reduces annotation time by up to 53% without sacrificing accuracy, validated through quantitative evaluation.

Contribution

It is the first to quantitatively evaluate the benefits of iterative model refinement in annotation efficiency and quality, providing practical guidelines for future annotation platform development.

Findings

Up to 53% reduction in annotation time.

Annotation quality maintained or improved.

Validated efficiency gains through experimental evaluation.

Abstract

Automated object detection has become increasingly valuable across diverse applications, yet efficient, high-quality annotation remains a persistent challenge. In this paper, we present the development and evaluation of a platform designed to interactively improve object detection models. The platform allows uploading and annotating images as well as fine-tuning object detection models. Users can then manually review and refine annotations, further creating improved snapshots that are used for automatic object detection on subsequent image uploads - a process we refer to as semi-automatic annotation resulting in a significant gain in annotation efficiency. Whereas iterative refinement of model results to speed up annotation has become common practice, we are the first to quantitatively evaluate its benefits with respect to time, effort, and interaction savings. Our experimental results show clear evidence for a significant time reduction of up to 53% for semi-automatic compared to manual annotation. Importantly, these efficiency gains did not compromise annotation quality, while matching or occasionally even exceeding the accuracy of manual annotations. These findings demonstrate the potential of our lightweight annotation platform for creating high-quality object detection datasets and provide best practices to guide future development of annotation platforms. The platform is open-source, with the frontend and backend repositories available on GitHub. To support the understanding of our labeling process, we have created an explanatory video demonstrating the methodology using microscopy images of E. coli bacteria as an example.