Authentic Hand Avatar from a Phone Scan via Universal Hand Model
Gyeongsik Moon, Weipeng Xu, Rohan Joshi, Chenglei Wu, Takaaki, Shiratori

TL;DR
This paper introduces a universal 3D hand model that can be quickly adapted from a phone scan to create authentic, high-fidelity hand avatars for AR/VR, improving accuracy and efficiency over previous methods.
Contribution
The paper proposes a novel universal hand model that simultaneously tracks and models hand meshes, reducing errors and streamlining the creation of personalized hand avatars from phone scans.
Findings
Effective adaptation of the UHM to individual hand scans.
Reduced error accumulation compared to separate tracking and modeling.
Successful creation of high-fidelity, authentic hand avatars.
Abstract
The authentic 3D hand avatar with every identifiable information, such as hand shapes and textures, is necessary for immersive experiences in AR/VR. In this paper, we present a universal hand model (UHM), which 1) can universally represent high-fidelity 3D hand meshes of arbitrary identities (IDs) and 2) can be adapted to each person with a short phone scan for the authentic hand avatar. For effective universal hand modeling, we perform tracking and modeling at the same time, while previous 3D hand models perform them separately. The conventional separate pipeline suffers from the accumulated errors from the tracking stage, which cannot be recovered in the modeling stage. On the other hand, ours does not suffer from the accumulated errors while having a much more concise overall pipeline. We additionally introduce a novel image matching loss function to address a skin sliding during the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman Motion and Animation · Human Pose and Action Recognition · Social Robot Interaction and HRI
