Lagrangian Motion Fields for Long-term Motion Generation

TL;DR

This paper introduces Lagrangian Motion Fields, a novel motion representation method that improves long-term motion generation by capturing temporal dynamics more effectively, leading to more coherent, diverse, and efficient motion sequences.

Contribution

The paper proposes Lagrangian Motion Fields, a new approach that models joint movements as supermotions, enhancing long-term motion generation without neural network preprocessing.

Findings

Outperforms existing methods in music-to-dance and text-to-motion tasks.

Produces more coherent, diverse, and high-quality long-term motion sequences.

Enables applications like infinite looping and fine-grained control.

Abstract

Long-term motion generation is a challenging task that requires producing coherent and realistic sequences over extended durations. Current methods primarily rely on framewise motion representations, which capture only static spatial details and overlook temporal dynamics. This approach leads to significant redundancy across the temporal dimension, complicating the generation of effective long-term motion. To overcome these limitations, we introduce the novel concept of Lagrangian Motion Fields, specifically designed for long-term motion generation. By treating each joint as a Lagrangian particle with uniform velocity over short intervals, our approach condenses motion representations into a series of "supermotions" (analogous to superpixels). This method seamlessly integrates static spatial information with interpretable temporal dynamics, transcending the limitations of existing network architectures and motion sequence content types. Our solution is versatile and lightweight, eliminating the need for neural network preprocessing. Our approach excels in tasks such as long-term music-to-dance generation and text-to-motion generation, offering enhanced efficiency, superior generation quality, and greater diversity compared to existing methods. Additionally, the adaptability of Lagrangian Motion Fields extends to applications like infinite motion looping and fine-grained controlled motion generation, highlighting its broad utility. Video demonstrations are available at https://plyfager.github.io/LaMoG.