PHRIT: Parametric Hand Representation with Implicit Template

TL;DR

PHRIT introduces a novel implicit template-based parametric hand model that combines the benefits of parametric meshes and implicit representations, enabling high-fidelity, differentiable, and skeleton-driven hand reconstruction.

Contribution

It presents PHRIT, a new implicit template approach for parametric hand modeling that improves reconstruction quality and flexibility over existing methods.

Findings

Achieves state-of-the-art performance in hand reconstruction tasks.

Demonstrates high-fidelity and realistic hand modeling.

Efficiently deforms canonical templates at infinite resolution.

Abstract

We propose PHRIT, a novel approach for parametric hand mesh modeling with an implicit template that combines the advantages of both parametric meshes and implicit representations. Our method represents deformable hand shapes using signed distance fields (SDFs) with part-based shape priors, utilizing a deformation field to execute the deformation. The model offers efficient high-fidelity hand reconstruction by deforming the canonical template at infinite resolution. Additionally, it is fully differentiable and can be easily used in hand modeling since it can be driven by the skeleton and shape latent codes. We evaluate PHRIT on multiple downstream tasks, including skeleton-driven hand reconstruction, shapes from point clouds, and single-view 3D reconstruction, demonstrating that our approach achieves realistic and immersive hand modeling with state-of-the-art performance.