Generalizable and Animatable Gaussian Head Avatar
Xuangeng Chu, Tatsuya Harada

TL;DR
GAGAvatar is a novel method for one-shot, real-time animatable head avatar reconstruction using 3D Gaussian parameters derived from a single image, outperforming previous neural radiance field-based approaches.
Contribution
The paper introduces a dual-lifting method to generate high-fidelity 3D Gaussians from a single image for animatable head avatars, enabling real-time reenactment without optimization.
Findings
Outperforms previous methods in reconstruction quality.
Achieves real-time reenactment speeds.
Can reconstruct unseen identities without optimization.
Abstract
In this paper, we propose Generalizable and Animatable Gaussian head Avatar (GAGAvatar) for one-shot animatable head avatar reconstruction. Existing methods rely on neural radiance fields, leading to heavy rendering consumption and low reenactment speeds. To address these limitations, we generate the parameters of 3D Gaussians from a single image in a single forward pass. The key innovation of our work is the proposed dual-lifting method, which produces high-fidelity 3D Gaussians that capture identity and facial details. Additionally, we leverage global image features and the 3D morphable model to construct 3D Gaussians for controlling expressions. After training, our model can reconstruct unseen identities without specific optimizations and perform reenactment rendering at real-time speeds. Experiments show that our method exhibits superior performance compared to previous methods in…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsFace recognition and analysis · Human Motion and Animation · 3D Shape Modeling and Analysis
