Context-Aware Semantic Inpainting
Haofeng Li, Guanbin Li, Liang Lin, Yizhou Yu

TL;DR
This paper introduces a novel GAN-based framework for semantic inpainting that preserves spatial structures and high-level semantics more effectively, along with new evaluation metrics, outperforming existing methods.
Contribution
The paper presents a fully convolutional generator and a joint loss with revised perceptual loss, along with two new metrics for better inpainting quality assessment.
Findings
Outperforms state-of-the-art methods across multiple criteria
Better preserves spatial structures in inpainted images
Effectively captures high-level semantic content
Abstract
Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder architecture with a fully connected layer, which cannot accurately maintain spatial information. In addition, the discriminator in existing GANs struggle to understand high-level semantics within the image context and yield semantically consistent content. Existing evaluation criteria are biased towards blurry results and cannot well characterize edge preservation and visual authenticity in the inpainting results. In this paper, we propose an improved generative adversarial network to overcome the aforementioned limitations. Our proposed GAN-based framework consists of a fully convolutional design for the generator which helps to better preserve spatial…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Advanced Image Processing Techniques · Digital Media Forensic Detection
