Reverse Personalization
Han-Wei Kung, Tuomas Varanka, Nicu Sebe

TL;DR
This paper introduces a reverse personalization framework for face anonymization using conditional diffusion inversion, enabling attribute-controlled anonymization without requiring model fine-tuning or well-represented subjects.
Contribution
It presents a novel method that allows direct, attribute-controllable face anonymization through diffusion model inversion and identity-guided conditioning.
Findings
Achieves state-of-the-art balance between identity removal and attribute preservation.
Operates without fine-tuning or reliance on well-represented subjects.
Supports attribute-controllable face anonymization.
Abstract
Recent text-to-image diffusion models have demonstrated remarkable generation of realistic facial images conditioned on textual prompts and human identities, enabling creating personalized facial imagery. However, existing prompt-based methods for removing or modifying identity-specific features rely either on the subject being well-represented in the pre-trained model or require model fine-tuning for specific identities. In this work, we analyze the identity generation process and introduce a reverse personalization framework for face anonymization. Our approach leverages conditional diffusion inversion, allowing direct manipulation of images without using text prompts. To generalize beyond subjects in the model's training data, we incorporate an identity-guided conditioning branch. Unlike prior anonymization methods, which lack control over facial attributes, our framework supports…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Face recognition and analysis · Face Recognition and Perception
