Controllable and Gradual Facial Blemishes Retouching via Physics-Based Modelling

TL;DR

This paper introduces CGFR, a physics-based method for controllable, realistic, and gradual facial blemish retouching that simulates the natural process of blemish recovery using skin scattering models.

Contribution

It presents a novel physics-based approach for facial blemish retouching that allows user control and realistic gradual changes, unlike previous methods.

Findings

Realistic simulation of blemish recovery process

User-friendly control over blemish retouching

Effective modeling of skin subsurface scattering

Abstract

Face retouching aims to remove facial blemishes, such as pigmentation and acne, and still retain fine-grain texture details. Nevertheless, existing methods just remove the blemishes but focus little on realism of the intermediate process, limiting their use more to beautifying facial images on social media rather than being effective tools for simulating changes in facial pigmentation and ance. Motivated by this limitation, we propose our Controllable and Gradual Face Retouching (CGFR). Our CGFR is based on physical modelling, adopting Sum-of-Gaussians to approximate skin subsurface scattering in a decomposed melanin and haemoglobin color space. Our CGFR offers a user-friendly control over the facial blemishes, achieving realistic and gradual blemishes retouching. Experimental results based on actual clinical data shows that CGFR can realistically simulate the blemishes' gradual recovering process.