YO-CSA-T: A Real-time Badminton Tracking System Utilizing YOLO Based on Contextual and Spatial Attention

TL;DR

This paper introduces YO-CSA-T, a real-time badminton shuttlecock tracking system that enhances detection accuracy and speed by integrating a novel YOLOv8s-based network with attention mechanisms and a 3D trajectory prediction framework.

Contribution

The paper proposes YO-CSA, a modified YOLOv8s model with attention modules, and a comprehensive real-time 3D trajectory detection system for badminton shuttlecocks, improving accuracy and efficiency.

Findings

YO-CSA achieves 90.43% mAP@0.75, outperforming YOLOv8s and YOLO11s.

System maintains over 130 fps in real-time detection.

Effective 3D trajectory prediction and compensation improve tracking continuity.

Abstract

The 3D trajectory of a shuttlecock required for a badminton rally robot for human-robot competition demands real-time performance with high accuracy. However, the fast flight speed of the shuttlecock, along with various visual effects, and its tendency to blend with environmental elements, such as court lines and lighting, present challenges for rapid and accurate 2D detection. In this paper, we first propose the YO-CSA detection network, which optimizes and reconfigures the YOLOv8s model's backbone, neck, and head by incorporating contextual and spatial attention mechanisms to enhance model's ability in extracting and integrating both global and local features. Next, we integrate three major subtasks, detection, prediction, and compensation, into a real-time 3D shuttlecock trajectory detection system. Specifically, our system maps the 2D coordinate sequence extracted by YO-CSA into 3D space using stereo vision, then predicts the future 3D coordinates based on historical information, and re-projects them onto the left and right views to update the position constraints for 2D detection. Additionally, our system includes a compensation module to fill in missing intermediate frames, ensuring a more complete trajectory. We conduct extensive experiments on our own dataset to evaluate both YO-CSA's performance and system effectiveness. Experimental results show that YO-CSA achieves a high accuracy of 90.43% mAP@0.75, surpassing both YOLOv8s and YOLO11s. Our system performs excellently, maintaining a speed of over 130 fps across 12 test sequences.