TimeWalker: Personalized Neural Space for Lifelong Head Avatars
Dongwei Pan, Yang Li, Hongsheng Li, Kwan-Yee Lin

TL;DR
TimeWalker introduces a neural framework for lifelong, personalized 3D head avatars that can be reconstructed and animated across different life stages using unstructured data, with realistic rendering and disentangled representations.
Contribution
The paper proposes a novel neural parametric model and a dynamic neural basis-blending module for lifelong personalized head avatars, enabling full reconstruction and animation across ages.
Findings
Effective lifelong head avatar reconstruction and animation.
Realistic rendering of head deformations and expressions.
Disentangled representation of shape, expression, and appearance.
Abstract
We present TimeWalker, a novel framework that models realistic, full-scale 3D head avatars of a person on lifelong scale. Unlike current human head avatar pipelines that capture identity at the momentary level(e.g., instant photography or short videos), TimeWalker constructs a person's comprehensive identity from unstructured data collection over his/her various life stages, offering a paradigm to achieve full reconstruction and animation of that person at different moments of life. At the heart of TimeWalker's success is a novel neural parametric model that learns personalized representation with the disentanglement of shape, expression, and appearance across ages. Central to our methodology are the concepts of two aspects: (1) We track back to the principle of modeling a person's identity in an additive combination of average head representation in the canonical space, and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsContext-Aware Activity Recognition Systems · Social Robot Interaction and HRI · Human Pose and Action Recognition
MethodsSparse Evolutionary Training
