CaPhy: Capturing Physical Properties for Animatable Human Avatars

TL;DR

CaPhy is a new method that reconstructs animatable human avatars with realistic clothing physics, enabling accurate deformations and wrinkles in novel poses by capturing physical properties from scans.

Contribution

It introduces a physics-based, data-driven approach for reconstructing dynamic clothing models that generalize to new poses, improving realism over prior methods.

Findings

Achieves realistic clothing deformations in novel poses

Estimates physical properties of garments from scans

Outperforms previous methods quantitatively and qualitatively

Abstract

We present CaPhy, a novel method for reconstructing animatable human avatars with realistic dynamic properties for clothing. Specifically, we aim for capturing the geometric and physical properties of the clothing from real observations. This allows us to apply novel poses to the human avatar with physically correct deformations and wrinkles of the clothing. To this end, we combine unsupervised training with physics-based losses and 3D-supervised training using scanned data to reconstruct a dynamic model of clothing that is physically realistic and conforms to the human scans. We also optimize the physical parameters of the underlying physical model from the scans by introducing gradient constraints of the physics-based losses. In contrast to previous work on 3D avatar reconstruction, our method is able to generalize to novel poses with realistic dynamic cloth deformations. Experiments on several subjects demonstrate that our method can estimate the physical properties of the garments, resulting in superior quantitative and qualitative results compared with previous methods.