Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitives
Ronghui Li, YuXiang Zhang, Yachao Zhang, Hongwen Zhang, Jie Guo, Yan, Zhang, Yebin Liu, Xiu Li

TL;DR
Lodge is a two-stage diffusion network that generates long, expressive dance sequences from music by combining coarse choreography with detailed motion refinement.
Contribution
Introducing Lodge, a novel coarse-to-fine diffusion architecture with dance primitives and foot contact optimization for long dance generation.
Findings
Successfully generates extremely long dance sequences.
Balances global choreography with local motion details.
Enhances physical realism through foot-ground contact optimization.
Abstract
We propose Lodge, a network capable of generating extremely long dance sequences conditioned on given music. We design Lodge as a two-stage coarse to fine diffusion architecture, and propose the characteristic dance primitives that possess significant expressiveness as intermediate representations between two diffusion models. The first stage is global diffusion, which focuses on comprehending the coarse-level music-dance correlation and production characteristic dance primitives. In contrast, the second-stage is the local diffusion, which parallelly generates detailed motion sequences under the guidance of the dance primitives and choreographic rules. In addition, we propose a Foot Refine Block to optimize the contact between the feet and the ground, enhancing the physical realism of the motion. Our approach can parallelly generate dance sequences of extremely long length, striking a…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman Motion and Animation · Diversity and Impact of Dance · Human Pose and Action Recognition
MethodsDiffusion
