POPDG: Popular 3D Dance Generation with PopDanceSet
Zhenye Luo, Min Ren, Xuecai Hu, Yongzhen Huang, Li Yao

TL;DR
This paper presents POPDG, a novel model and dataset for generating diverse, lifelike 3D dances aligned with music, surpassing previous datasets and models in quality, diversity, and temporal synchronization.
Contribution
Introduction of PopDanceSet dataset tailored for young audiences and the POPDG model with innovative modules for enhanced dance diversity and alignment.
Findings
POPDG achieves state-of-the-art results on two datasets.
PopDanceSet surpasses AIST++ in genre diversity and dance complexity.
Enhanced spatial and temporal modules improve dance quality and synchronization.
Abstract
Generating dances that are both lifelike and well-aligned with music continues to be a challenging task in the cross-modal domain. This paper introduces PopDanceSet, the first dataset tailored to the preferences of young audiences, enabling the generation of aesthetically oriented dances. And it surpasses the AIST++ dataset in music genre diversity and the intricacy and depth of dance movements. Moreover, the proposed POPDG model within the iDDPM framework enhances dance diversity and, through the Space Augmentation Algorithm, strengthens spatial physical connections between human body joints, ensuring that increased diversity does not compromise generation quality. A streamlined Alignment Module is also designed to improve the temporal alignment between dance and music. Extensive experiments show that POPDG achieves SOTA results on two datasets. Furthermore, the paper also expands on…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman Motion and Animation · 3D Shape Modeling and Analysis · Generative Adversarial Networks and Image Synthesis
