TL;DR
This paper demonstrates that the architecture of deep convolutional networks alone can serve as an effective image prior for various restoration tasks without any training, bridging learned and handcrafted methods.
Contribution
It shows that a randomly-initialized neural network architecture can act as a powerful prior for image restoration, without requiring learned weights.
Findings
Randomly-initialized networks perform well in denoising, super-resolution, and inpainting.
The approach bridges learned deep priors and handcrafted image priors.
The method can invert neural representations and restore images from flash-no flash pairs.
Abstract
Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this paper, we show that, on the contrary, the structure of a generator network is sufficient to capture a great deal of low-level image statistics prior to any learning. In order to do so, we show that a randomly-initialized neural network can be used as a handcrafted prior with excellent results in standard inverse problems such as denoising, super-resolution, and inpainting. Furthermore, the same prior can be used to invert deep neural representations to diagnose them, and to restore images based on flash-no flash input pairs. Apart from its diverse applications, our approach highlights the inductive bias captured by standard generator network…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
