Free-body Gesture Tracking and Augmented Reality Improvisation for Floor and Aerial Dance
Tammuz Dubnov, Cheng-i Wang

TL;DR
This paper presents an advanced interactive system for floor and aerial dance that uses depth sensing and gesture recognition to enable dynamic improvisation and real-time visual and sonic control.
Contribution
It introduces the Action Graph system for automatic, efficient gesture tracking and recognition, allowing performers to improvise within a dynamically recognized choreography.
Findings
Enhanced multi-target gesture tracking capabilities.
Real-time recognition of repeated movement segments.
Enables improvisation based on recorded gestures.
Abstract
This paper describes an updated interactive performance system for floor and Aerial Dance that controls visual and sonic aspects of the presentation via a depth sensing camera (MS Kinect). In order to detect, measure and track free movement in space, 3 degree of freedom (3-DOF) tracking in space (on the ground and in the air) is performed using IR markers with a method for multi target tracking capabilities added and described in detail. An improved gesture tracking and recognition system, called Action Graph (AG), is described in the paper. Action Graph uses an efficient incremental construction from a single long sequence of movement features and automatically captures repeated sub-segments in the movement from start to finish with no manual interaction needed with other advanced capabilities discussed as well. By using the new model for the gesture we can unify an entire choreography…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman Motion and Animation · Diversity and Impact of Dance · Human Pose and Action Recognition
