Attribute Controllable Beautiful Caucasian Face Generation by Aesthetics Driven Reinforcement Learning

TL;DR

This paper introduces a reinforcement learning-based method to control and enhance the aesthetic appeal of generated face images, making them more attractive by adjusting semantic attributes.

Contribution

It integrates reinforcement learning into EigenGAN to optimize face attributes for better aesthetics, a novel approach in face image generation.

Findings

Generated faces are more attractive and aesthetically pleasing.

The method effectively correlates face attributes with aesthetic scores.

Experimental results confirm improved aesthetic levels in generated images.

Abstract

In recent years, image generation has made great strides in improving the quality of images, producing high-fidelity ones. Also, quite recently, there are architecture designs, which enable GAN to unsupervisedly learn the semantic attributes represented in different layers. However, there is still a lack of research on generating face images more consistent with human aesthetics. Based on EigenGAN [He et al., ICCV 2021], we build the techniques of reinforcement learning into the generator of EigenGAN. The agent tries to figure out how to alter the semantic attributes of the generated human faces towards more preferable ones. To accomplish this, we trained an aesthetics scoring model that can conduct facial beauty prediction. We also can utilize this scoring model to analyze the correlation between face attributes and aesthetics scores. Empirically, using off-the-shelf techniques from reinforcement learning would not work well. So instead, we present a new variant incorporating the ingredients emerging in the reinforcement learning communities in recent years. Compared to the original generated images, the adjusted ones show clear distinctions concerning various attributes. Experimental results using the MindSpore, show the effectiveness of the proposed method. Altered facial images are commonly more attractive, with significantly improved aesthetic levels.