Dance of Fireworks: An Interactive Broadcast Gymnastics Training System Based on Pose Estimation

TL;DR

Dance of Fireworks is an interactive system that uses mobile pose estimation to promote exercise by providing real-time feedback and engaging visual rewards, effectively encouraging physical activity in sedentary individuals.

Contribution

It introduces a novel, hardware-free interactive exercise system that combines pose estimation with gamified visual effects to enhance engagement and exercise accuracy.

Findings

Significant reduction in joint angle errors from 21.3° to 9.8°

93.4% of users found it effective for exercise promotion

85.4% praised its entertainment value

Abstract

This study introduces Dance of Fireworks, an interactive system designed to combat sedentary health risks by enhancing engagement in radio calisthenics. Leveraging mobile device cameras and lightweight pose estimation (PoseNet/TensorFlow Lite), the system extracts body keypoints, computes joint angles, and compares them with standardized motions to deliver real-time corrective feedback. To incentivize participation, it dynamically maps users' movements (such as joint angles and velocity) to customizable fireworks animations, rewarding improved accuracy with richer visual effects. Experiments involving 136 participants demonstrated a significant reduction in average joint angle errors from 21.3 degrees to 9.8 degrees (p < 0.01) over four sessions, with 93.4 percent of users affirming its exercise-promoting efficacy and 85.4 percent praising its entertainment value. The system operates without predefined motion templates or specialised hardware, enabling seamless integration into office environments. Future enhancements will focus on improving pose recognition accuracy, reducing latency, and adding features such as multiplayer interaction and music synchronisation. This work presents a cost-effective, engaging solution to promote physical activity in sedentary populations.