MATrack: Efficient Multiscale Adaptive Tracker for Real-Time Nighttime UAV Operations

TL;DR

MATrack is a novel multiscale adaptive tracking system designed for real-time nighttime UAV operations, addressing low-light and dynamic background challenges with three core modules, significantly improving accuracy and robustness.

Contribution

The paper introduces MATrack, a new multiscale adaptive tracking framework specifically optimized for nighttime UAV tracking, combining three innovative modules for enhanced performance.

Findings

Outperforms state-of-the-art methods on UAVDark135 benchmark by 5.9% in precision.

Maintains real-time processing at 81 FPS.

Validated on real UAV platform for reliable nighttime tracking.

Abstract

Nighttime UAV tracking faces significant challenges in real-world robotics operations. Low-light conditions not only limit visual perception capabilities, but cluttered backgrounds and frequent viewpoint changes also cause existing trackers to drift or fail during deployment. To address these difficulties, researchers have proposed solutions based on low-light enhancement and domain adaptation. However, these methods still have notable shortcomings in actual UAV systems: low-light enhancement often introduces visual artifacts, domain adaptation methods are computationally expensive and existing lightweight designs struggle to fully leverage dynamic object information. Based on an in-depth analysis of these key issues, we propose MATrack-a multiscale adaptive system designed specifically for nighttime UAV tracking. MATrack tackles the main technical challenges of nighttime tracking through the collaborative work of three core modules: Multiscale Hierarchy Blende (MHB) enhances feature consistency between static and dynamic templates. Adaptive Key Token Gate accurately identifies object information within complex backgrounds. Nighttime Template Calibrator (NTC) ensures stable tracking performance over long sequences. Extensive experiments show that MATrack achieves a significant performance improvement. On the UAVDark135 benchmark, its precision, normalized precision and AUC surpass state-of-the-art (SOTA) methods by 5.9%, 5.4% and 4.2% respectively, while maintaining a real-time processing speed of 81 FPS. Further tests on a real-world UAV platform validate the system's reliability, demonstrating that MATrack can provide stable and effective nighttime UAV tracking support for critical robotics applications such as nighttime search and rescue and border patrol.