Few-Shot Head Swapping in the Wild
Changyong Shu, Hemao Wu, Hang Zhou, Jiaming Liu, Zhibin Hong,, Changxing Ding, Junyu Han, Jingtuo Liu, Errui Ding, Jingdong Wang

TL;DR
This paper introduces HeSer, a novel few-shot head swapping method that effectively aligns pose and expression while seamlessly blending heads onto different bodies in diverse scenes.
Contribution
The paper presents two innovative modules, Head2Head Aligner and Head2Scene Blender, for robust few-shot head swapping in the wild, addressing pose, expression, skin color, and background mismatches.
Findings
Achieves superior head swapping quality in various scenes.
Effectively handles pose, expression, and background mismatches.
Demonstrates robustness in wild, real-world scenarios.
Abstract
The head swapping task aims at flawlessly placing a source head onto a target body, which is of great importance to various entertainment scenarios. While face swapping has drawn much attention, the task of head swapping has rarely been explored, particularly under the few-shot setting. It is inherently challenging due to its unique needs in head modeling and background blending. In this paper, we present the Head Swapper (HeSer), which achieves few-shot head swapping in the wild through two delicately designed modules. Firstly, a Head2Head Aligner is devised to holistically migrate pose and expression information from the target to the source head by examining multi-scale information. Secondly, to tackle the challenges of skin color variations and head-background mismatches in the swapping procedure, a Head2Scene Blender is introduced to simultaneously modify facial skin color and fill…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFace recognition and analysis · Generative Adversarial Networks and Image Synthesis · Human Motion and Animation
MethodsRoIPool · RoIAlign · Softmax
