X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latents

TL;DR

X-UniMotion introduces a unified, expressive, and identity-agnostic motion representation for human images, enabling high-fidelity, cross-identity motion transfer across diverse subjects and poses.

Contribution

It proposes a novel implicit latent representation with four disentangled tokens for comprehensive human motion, trained via a self-supervised framework on large datasets.

Findings

Outperforms existing methods in motion fidelity and identity preservation.

Enables detailed and expressive cross-identity human motion transfer.

Uses a self-supervised, end-to-end training approach with auxiliary decoders.

Abstract

We present X-UniMotion, a unified and expressive implicit latent representation for whole-body human motion, encompassing facial expressions, body poses, and hand gestures. Unlike prior motion transfer methods that rely on explicit skeletal poses and heuristic cross-identity adjustments, our approach encodes multi-granular motion directly from a single image into a compact set of four disentangled latent tokens -- one for facial expression, one for body pose, and one for each hand. These motion latents are both highly expressive and identity-agnostic, enabling high-fidelity, detailed cross-identity motion transfer across subjects with diverse identities, poses, and spatial configurations. To achieve this, we introduce a self-supervised, end-to-end framework that jointly learns the motion encoder and latent representation alongside a DiT-based video generative model, trained on large-scale, diverse human motion datasets. Motion-identity disentanglement is enforced via 2D spatial and color augmentations, as well as synthetic 3D renderings of cross-identity subject pairs under shared poses. Furthermore, we guide motion token learning with auxiliary decoders that promote fine-grained, semantically aligned, and depth-aware motion embeddings. Extensive experiments show that X-UniMotion outperforms state-of-the-art methods, producing highly expressive animations with superior motion fidelity and identity preservation.