Easy-Poly: An Easy Polyhedral Framework For 3D Multi-Object Tracking

TL;DR

Easy-Poly introduces a robust, filter-based 3D multi-object tracking framework that improves detection accuracy and identity consistency in crowded scenarios through innovative fusion, association, and motion modeling techniques.

Contribution

The paper presents a novel filter-based 3D MOT framework with four key innovations, including a new detection method, data association, motion modeling, and lifecycle management, enhancing robustness and real-time performance.

Findings

Outperforms state-of-the-art methods in mAP and AMOTA metrics.

Achieves real-time processing suitable for autonomous driving.

Significantly reduces identity switches and false terminations.

Abstract

Recent 3D multi-object tracking (3D MOT) methods mainly follow tracking-by-detection pipelines, but often suffer from high false positives, missed detections, and identity switches, especially in crowded and small-object scenarios. To address these challenges, we propose Easy-Poly, a filter-based 3D MOT framework with four key innovations: (1) CNMSMM, a novel Camera-LiDAR fusion detection method combining multi-modal augmentation and an efficient NMS with a new loss function to improve small target detection; (2) Dynamic Track-Oriented (DTO) data association that robustly handles uncertainties and occlusions via class-aware optimal assignment and parallel processing strategies; (3) Dynamic Motion Modeling (DMM) using a confidence-weighted Kalman filter with adaptive noise covariance to enhance tracking accuracy; and (4) an extended life-cycle management system reducing identity switches and false terminations. Experimental results show that Easy-Poly outperforms state-of-the-art methods such as Poly-MOT and Fast-Poly, achieving notable gains in mAP (e.g., from 63.30% to 65.65% with LargeKernel3D) and AMOTA (e.g., from 73.1% to 75.6%), while also running in real-time. Our framework advances robustness and adaptability in complex driving environments, paving the way for safer autonomous driving perception.