Blind Image Inpainting with Sparse Directional Filter Dictionaries for Lightweight CNNs
Jenny Schmalfuss, Erik Scheurer, Heng Zhao, Nikolaos, Karantzas, Andr\'es Bruhn, Demetrio Labate

TL;DR
This paper introduces a hybrid CNN-based blind image inpainting method that incorporates transform domain concepts and sparse filter dictionaries, achieving better quality and faster convergence in lightweight networks.
Contribution
It presents a novel strategy to learn convolutional kernels using a designed filter dictionary combined with trainable weights, integrating theoretical foundations into CNNs.
Findings
Improved inpainting quality over traditional CNNs.
Faster network convergence.
Maintains lightweight network design.
Abstract
Blind inpainting algorithms based on deep learning architectures have shown a remarkable performance in recent years, typically outperforming model-based methods both in terms of image quality and run time. However, neural network strategies typically lack a theoretical explanation, which contrasts with the well-understood theory underlying model-based methods. In this work, we leverage the advantages of both approaches by integrating theoretically founded concepts from transform domain methods and sparse approximations into a CNN-based approach for blind image inpainting. To this end, we present a novel strategy to learn convolutional kernels that applies a specifically designed filter dictionary whose elements are linearly combined with trainable weights. Numerical experiments demonstrate the competitiveness of this approach. Our results show not only an improved inpainting quality…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage and Signal Denoising Methods · Advanced Image Processing Techniques · Generative Adversarial Networks and Image Synthesis
MethodsInpainting
