Gorgeous: Create Your Desired Character Facial Makeup from Any Ideas

TL;DR

Gorgeous is a diffusion-based method that creates unique, thematic character facial makeup directly on faces, using minimal reference images without needing face-specific references, thus enhancing storytelling and visual creativity.

Contribution

The paper introduces Gorgeous, a novel diffusion-based approach that generates character makeup from diverse, non-face references, overcoming limitations of traditional transfer methods.

Findings

Effectively generates distinctive character makeup inspired by thematic references.

Does not require face images in reference set, broadening creative possibilities.

Enhances narrative depth through customizable makeup design.

Abstract

Contemporary makeup transfer methods primarily focus on replicating makeup from one face to another, considerably limiting their use in creating diverse and creative character makeup essential for visual storytelling. Such methods typically fail to address the need for uniqueness and contextual relevance, specifically aligning with character and story settings as they depend heavily on existing facial makeup in reference images. This approach also presents a significant challenge when attempting to source a perfectly matched facial makeup style, further complicating the creation of makeup designs inspired by various story elements, such as theme, background, and props that do not necessarily feature faces. To address these limitations, we introduce $Gorgeous$, a novel diffusion-based makeup application method that goes beyond simple transfer by innovatively crafting unique and thematic facial makeup. Unlike traditional methods, $Gorgeous$ does not require the presence of a face in the reference images. Instead, it draws artistic inspiration from a minimal set of three to five images, which can be of any type, and transforms these elements into practical makeup applications directly on the face. Our comprehensive experiments demonstrate that $Gorgeous$ can effectively generate distinctive character facial makeup inspired by the chosen thematic reference images. This approach opens up new possibilities for integrating broader story elements into character makeup, thereby enhancing the narrative depth and visual impact in storytelling.