DEff-GAN: Diverse Attribute Transfer for Few-Shot Image Synthesis

TL;DR

DEff-GAN introduces a method for few-shot image synthesis that models multiple images to generate diverse samples, leveraging shared features and relationships between limited input images.

Contribution

The paper extends single-image GANs to multi-image scenarios using an auxiliary classifier, enabling diverse and relationship-aware image synthesis from few samples.

Findings

Generates diverse samples with limited data

Effective when input images share similarities

Outperforms existing few-shot GAN methods

Abstract

Requirements of large amounts of data is a difficulty in training many GANs. Data efficient GANs involve fitting a generators continuous target distribution with a limited discrete set of data samples, which is a difficult task. Single image methods have focused on modeling the internal distribution of a single image and generating its samples. While single image methods can synthesize image samples with diversity, they do not model multiple images or capture the inherent relationship possible between two images. Given only a handful of images, we are interested in generating samples and exploiting the commonalities in the input images. In this work, we extend the single-image GAN method to model multiple images for sample synthesis. We modify the discriminator with an auxiliary classifier branch, which helps to generate a wide variety of samples and to classify the input labels. Our Data-Efficient GAN (DEff-GAN) generates excellent results when similarities and correspondences can be drawn between the input images or classes.