View-Centric Multi-Object Tracking with Homographic Matching in Moving UAV

TL;DR

This paper introduces HomView-MOT, a novel framework for multi-object tracking in moving UAV scenarios that uses view homography and homographic matching to improve tracking accuracy amidst complex scene changes.

Contribution

It presents a new HomView-MOT framework that leverages view homography, a fast homography estimation algorithm, and a homographic matching filter to enhance multi-object tracking in moving UAV environments.

Findings

Achieves state-of-the-art results on VisDrone and UAVDT datasets.

Outperforms traditional methods in handling view shifts and background changes.

Demonstrates robustness in complex UAV flight scenarios.

Abstract

In this paper, we address the challenge of Multi-Object Tracking (MOT) in moving Unmanned Aerial Vehicle (UAV) scenarios, where irregular flight trajectories, such as hovering, turning left/right, and moving up/down, lead to significantly greater complexity compared to fixed-camera MOT. Specifically, changes in the scene background not only render traditional frame-to-frame object IoU association methods ineffective but also introduce significant view shifts in the objects, which complicates tracking. To overcome these issues, we propose a novel HomView-MOT framework, which for the first time, harnesses the view homography inherent in changing scenes to solve MOT challenges in moving environments, incorporating homographic matching and view-centric concepts. We introduce a Fast Homography Estimation (FHE) algorithm for rapid computation of homography matrices between video frames, enabling object View-Centric ID Learning (VCIL) and leveraging multi-view homography to learn cross-view ID features. Concurrently, our Homographic Matching Filter (HMF) maps object bounding boxes from different frames onto a common view plane for a more realistic physical IoU association. Extensive experiments have proven that these innovations allow HomView-MOT to achieve state-of-the-art performance on prominent UAV MOT datasets VisDrone and UAVDT.