PhyDeformer: High-Quality Non-Rigid Garment Registration with Physics-Awareness

TL;DR

PhyDeformer is a novel two-phase deformation approach for high-quality non-rigid garment registration that combines coarse grading with fine detail refinement using physics-aware optimization.

Contribution

It introduces a two-phase process integrating garment grading and Jacobian-based deformation for improved registration accuracy.

Findings

Effective on synthetic and real garments

Outperforms existing methods in quality and detail

Combines coarse and fine registration stages

Abstract

We present PhyDeformer, a new deformation method for high-quality garment mesh registration. It operates in two phases: In the first phase, a garment grading is performed to achieve a coarse 3D alignment between the mesh template and the target mesh, accounting for proportional scaling and fit (e.g. length, size). Then, the graded mesh is refined to align with the fine-grained details of the 3D target through an optimization coupled with the Jacobian-based deformation framework. Both quantitative and qualitative evaluations on synthetic and real garments highlight the effectiveness of our method.