R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object

TL;DR

R3Det introduces a refined single-stage rotation detection method that employs feature refinement and a progressive regression approach, significantly improving accuracy for rotating objects with complex shapes and distributions.

Contribution

The paper proposes a novel feature refinement module and an approximate SkewIoU loss for more accurate rotation detection in a single-stage framework.

Findings

Effective on multiple remote sensing datasets

Improves detection accuracy for dense and large aspect ratio objects

Achieves state-of-the-art results in rotation detection

Abstract

Rotation detection is a challenging task due to the difficulties of locating the multi-angle objects and separating them effectively from the background. Though considerable progress has been made, for practical settings, there still exist challenges for rotating objects with large aspect ratio, dense distribution and category extremely imbalance. In this paper, we propose an end-to-end refined single-stage rotation detector for fast and accurate object detection by using a progressive regression approach from coarse to fine granularity. Considering the shortcoming of feature misalignment in existing refined single-stage detector, we design a feature refinement module to improve detection performance by getting more accurate features. The key idea of feature refinement module is to re-encode the position information of the current refined bounding box to the corresponding feature points through pixel-wise feature interpolation to realize feature reconstruction and alignment. For more accurate rotation estimation, an approximate SkewIoU loss is proposed to solve the problem that the calculation of SkewIoU is not derivable. Experiments on three popular remote sensing public datasets DOTA, HRSC2016, UCAS-AOD as well as one scene text dataset ICDAR2015 show the effectiveness of our approach. Tensorflow and Pytorch version codes are available at https://github.com/Thinklab-SJTU/R3Det_Tensorflow and https://github.com/SJTU-Thinklab-Det/r3det-on-mmdetection, and R3Det is also integrated in our open source rotation detection benchmark: https://github.com/yangxue0827/RotationDetection.