One-shot Face Reenactment
Yunxuan Zhang, Siwei Zhang, Yue He, Cheng Li, Chen Change Loy, Ziwei, Liu

TL;DR
This paper introduces a one-shot face reenactment framework that effectively transfers pose and expression from a source to a target face using only one target image, outperforming existing methods in fidelity and identity preservation.
Contribution
The work proposes a novel one-shot learning approach that disentangles appearance and shape, and introduces FusionNet to enhance synthesis quality, enabling high-quality face reenactment with minimal target data.
Findings
Achieves superior transfer fidelity and identity preservation.
Performs competitively with methods using multiple target images.
Demonstrates practical application with only one target image.
Abstract
To enable realistic shape (e.g. pose and expression) transfer, existing face reenactment methods rely on a set of target faces for learning subject-specific traits. However, in real-world scenario end-users often only have one target face at hand, rendering existing methods inapplicable. In this work, we bridge this gap by proposing a novel one-shot face reenactment learning framework. Our key insight is that the one-shot learner should be able to disentangle and compose appearance and shape information for effective modeling. Specifically, the target face appearance and the source face shape are first projected into latent spaces with their corresponding encoders. Then these two latent spaces are associated by learning a shared decoder that aggregates multi-level features to produce the final reenactment results. To further improve the synthesizing quality on mustache and hair regions,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFace recognition and analysis · Generative Adversarial Networks and Image Synthesis · Advanced Image Processing Techniques
