Omni-ID: Holistic Identity Representation Designed for Generative Tasks
Guocheng Qian, Kuan-Chieh Wang, Or Patashnik, Negin Heravi, Daniil Ostashev, Sergey Tulyakov, Daniel Cohen-Or, Kfir Aberman

TL;DR
Omni-ID introduces a holistic facial representation optimized for generative tasks, capturing diverse identity features from multiple images, and outperforming traditional discriminative methods in various generative applications.
Contribution
The paper presents Omni-ID, a new generative-optimized facial representation that encodes comprehensive identity information from multiple images using a multi-decoder framework.
Findings
Outperforms traditional representations like CLIP and ArcFace in generative tasks
Effectively encodes diverse expressions and poses in a fixed-size representation
Demonstrates substantial improvements on the MFHQ dataset
Abstract
We introduce Omni-ID, a novel facial representation designed specifically for generative tasks. Omni-ID encodes holistic information about an individual's appearance across diverse expressions and poses within a fixed-size representation. It consolidates information from a varied number of unstructured input images into a structured representation, where each entry represents certain global or local identity features. Our approach uses a few-to-many identity reconstruction training paradigm, where a limited set of input images is used to reconstruct multiple target images of the same individual in various poses and expressions. A multi-decoder framework is further employed to leverage the complementary strengths of diverse decoders during training. Unlike conventional representations, such as CLIP and ArcFace, which are typically learned through discriminative or contrastive objectives,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsPrivacy, Security, and Data Protection · Opportunistic and Delay-Tolerant Networks
MethodsSparse Evolutionary Training · Contrastive Language-Image Pre-training · Additive Angular Margin Loss
