FaceCrafter: Identity-Conditional Diffusion with Disentangled Control over Facial Pose, Expression, and Emotion
Kazuaki Mishima, Antoni Bigata Casademunt, Stavros Petridis, Maja Pantic, Kenji Suzuki

TL;DR
FaceCrafter introduces a diffusion-based face synthesis model that independently controls facial pose, expression, and emotion, achieving high-quality, diverse, and identity-preserving face generation with precise attribute manipulation.
Contribution
The paper presents a novel identity-conditional diffusion model with lightweight control modules for disentangled manipulation of facial attributes, enhancing controllability and diversity.
Findings
Outperforms existing methods in control accuracy for pose, expression, and emotion.
Improves diversity of generated faces under identity-only conditioning.
Demonstrates superior qualitative and quantitative results through evaluations and user studies.
Abstract
Human facial images encode a rich spectrum of information, encompassing both stable identity-related traits and mutable attributes such as pose, expression, and emotion. While recent advances in image generation have enabled high-quality identity-conditional face synthesis, precise control over non-identity attributes remains challenging, and disentangling identity from these mutable factors is particularly difficult. To address these limitations, we propose a novel identity-conditional diffusion model that introduces two lightweight control modules designed to independently manipulate facial pose, expression, and emotion without compromising identity preservation. These modules are embedded within the cross-attention layers of the base diffusion model, enabling precise attribute control with minimal parameter overhead. Furthermore, our tailored training strategy, which leverages…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFace recognition and analysis
MethodsDiffusion · Balanced Selection
