# LightTrack-ReID: A lightweight and occlusion-robust framework for multi-object tracking

## TL;DR

LightTrack-ReID is a lightweight framework for multi-object tracking that performs well even when objects are partially hidden.

## Contribution

The paper introduces a novel lightweight and occlusion-robust framework with efficient components for real-time multi-object tracking.

## Key findings

- LightTrack-ReID achieves HOTA scores of 66.92 on MOT17 and 66.6 on MOT20.
- The framework maintains real-time performance at approximately 30 FPS on a GTX1080 GPU.
- It significantly reduces identity switches while maintaining high IDF1 scores of 82.52 and 82.2.

## Abstract

This paper presents LightTrack-ReID, an advanced, lightweight, and occlusion-resistant framework for MOT, designed for real-time performance in resource-limited environments. The framework includes a Lightweight Appearance Encoder (LAE) using MobileNetV3-Small, Transformer-Based Similarity Scoring (TBSS), Context Memory for Occlusion Handling (CMOH), and Adaptive Similarity Weighting (ASW) to enhance tracklet association in situations of heavy occlusion. These components offer compact 32-dimensional ReID features, adaptive similarity metrics, and continuous tracking within an efficient single-stage detection-to-tracklet association system. The proposed similarity and association model operates at approximately 0.6 GFLOPs per frame (LAE approximately 0.5 GFLOPs + TBSS approximately 0.1 GFLOPs). When integrated with the YOLOX-S detector, which remains the dominant computation, the full pipeline maintains approximately 30 FPS real-time performance on a GTX1080 GPU. It demonstrates robust performance on the MOT17 and MOT20 benchmarks, achieving Higher Order Tracking Accuracy(HOTA) scores of 66.92 and 66.6 and IDentity F1 score(IDF1) scores of 82.52 and 82.2, respectively, while significantly reducing identity switches. These results confirm its strength and appropriateness for use in real-world applications.