Local Padding in Patch-Based GANs for Seamless Infinite-Sized Texture Synthesis

TL;DR

This paper introduces local padding in patch-based GANs to improve large-scale texture synthesis, ensuring boundary consistency and enabling infinite-sized image generation with higher quality and diversity.

Contribution

The novel local padding approach replaces zero-padding in GANs, allowing seamless patch boundary sharing and scalable infinite texture generation from a single image.

Findings

Significant improvement in texture quality and diversity.

Elimination of tiling artifacts in super-resolution models.

Constant GPU scalability for large image synthesis.

Abstract

Texture models based on Generative Adversarial Networks (GANs) use zero-padding to implicitly encode positional information of the image features. However, when extending the spatial input to generate images at large sizes, zero-padding can often lead to degradation in image quality due to the incorrect positional information at the center of the image. Moreover, zero-padding can limit the diversity within the generated large images. In this paper, we propose a novel approach for generating stochastic texture images at large arbitrary sizes using GANs based on patch-by-patch generation. Instead of zero-padding, the model uses \textit{local padding} in the generator that shares border features between the generated patches; providing positional context and ensuring consistency at the boundaries. The proposed models are trainable on a single texture image and have a constant GPU scalability with respect to the output image size, and hence can generate images of infinite sizes. We show in the experiments that our method has a significant advancement beyond existing GANs-based texture models in terms of the quality and diversity of the generated textures. Furthermore, the implementation of local padding in the state-of-the-art super-resolution models effectively eliminates tiling artifacts enabling large-scale super-resolution. Our code is available at \url{https://github.com/ai4netzero/Infinite_Texture_GANs}.