Learning Texture Manifolds with the Periodic Spatial GAN

TL;DR

This paper presents PSGAN, a novel GAN-based method for flexible, scalable texture synthesis that learns multiple textures, interpolates between them smoothly, and accurately models periodic textures, surpassing previous methods.

Contribution

Introduction of PSGAN, a new GAN architecture that learns multiple textures, interpolates smoothly in texture space, and models periodic textures effectively.

Findings

PSGAN can learn multiple complex textures from datasets.

It enables smooth interpolation between textures in the noise space.

It accurately synthesizes periodic textures and scales to large images.

Abstract

This paper introduces a novel approach to texture synthesis based on generative adversarial networks (GAN) (Goodfellow et al., 2014). We extend the structure of the input noise distribution by constructing tensors with different types of dimensions. We call this technique Periodic Spatial GAN (PSGAN). The PSGAN has several novel abilities which surpass the current state of the art in texture synthesis. First, we can learn multiple textures from datasets of one or more complex large images. Second, we show that the image generation with PSGANs has properties of a texture manifold: we can smoothly interpolate between samples in the structured noise space and generate novel samples, which lie perceptually between the textures of the original dataset. In addition, we can also accurately learn periodical textures. We make multiple experiments which show that PSGANs can flexibly handle diverse texture and image data sources. Our method is highly scalable and it can generate output images of arbitrary large size.