Generator Pyramid for High-Resolution Image Inpainting
Leilei Cao, Tong Yang, Yixu Wang, Bo Yan, Yandong Guo

TL;DR
This paper introduces PyramidFill, a multi-scale GAN framework that improves high-resolution image inpainting by separately handling content completion at low resolution and texture synthesis at high resolution, achieving superior results.
Contribution
The novel PyramidFill framework explicitly disentangles content and texture synthesis across resolutions using a pyramid of specialized GANs, advancing high-resolution inpainting techniques.
Findings
Outperforms state-of-the-art methods on multiple datasets.
Effectively handles large holes in high-resolution images.
Demonstrates superior quality in natural scenery inpainting.
Abstract
Inpainting high-resolution images with large holes challenges existing deep learning based image inpainting methods. We present a novel framework -- PyramidFill for high-resolution image inpainting task, which explicitly disentangles content completion and texture synthesis. PyramidFill attempts to complete the content of unknown regions in a lower-resolution image, and synthesis the textures of unknown regions in a higher-resolution image, progressively. Thus, our model consists of a pyramid of fully convolutional GANs, wherein the content GAN is responsible for completing contents in the lowest-resolution masked image, and each texture GAN is responsible for synthesizing textures in a higher-resolution image. Since completing contents and synthesising textures demand different abilities from generators, we customize different architectures for the content GAN and texture GAN.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
MethodsInpainting
