Dual Learning Music Composition and Dance Choreography
Shuang Wu, Zhenguang Li, Shijian Lu, Li Cheng

TL;DR
This paper introduces a dual learning framework that jointly models music composition and dance choreography, leveraging optimal transport and cycle consistency to improve the quality and coherence of generated outputs.
Contribution
It presents the first dual learning approach for simultaneous music and dance generation, incorporating novel alignment and consistency mechanisms.
Findings
Enhanced quality of generated music and dance sequences.
Improved coherence between music and dance outputs.
Dual learning outperforms single-task models.
Abstract
Music and dance have always co-existed as pillars of human activities, contributing immensely to the cultural, social, and entertainment functions in virtually all societies. Notwithstanding the gradual systematization of music and dance into two independent disciplines, their intimate connection is undeniable and one art-form often appears incomplete without the other. Recent research works have studied generative models for dance sequences conditioned on music. The dual task of composing music for given dances, however, has been largely overlooked. In this paper, we propose a novel extension, where we jointly model both tasks in a dual learning approach. To leverage the duality of the two modalities, we introduce an optimal transport objective to align feature embeddings, as well as a cycle consistency loss to foster overall consistency. Experimental results demonstrate that our dual…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
MethodsCycle Consistency Loss
