Regularized Training of Intermediate Layers for Generative Models for Inverse Problems

TL;DR

This paper proposes a new regularized training method for generative models, specifically designed to improve inversion tasks like compressed sensing, inpainting, and super-resolution by reducing representation error through intermediate layer regularization.

Contribution

It introduces a novel regularized training algorithm tailored for generative models used in inversion algorithms based on intermediate layer optimization.

Findings

Lower reconstruction errors across various under sampling ratios.

Improved performance in compressed sensing, inpainting, and super-resolution.

Demonstrated effectiveness of regularized training for inversion tasks.

Abstract

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in representing any particular signal. Recently, multiple proposed inversion algorithms reduce representation error by optimizing over intermediate layer representations. These methods are typically applied to generative models that were trained agnostic of the downstream inversion algorithm. In our work, we introduce a principle that if a generative model is intended for inversion using an algorithm based on optimization of intermediate layers, it should be trained in a way that regularizes those intermediate layers. We instantiate this principle for two notable recent inversion algorithms: Intermediate Layer Optimization and the Multi-Code GAN prior. For both of these inversion algorithms, we introduce a new regularized GAN training algorithm and demonstrate that the learned generative model results in lower reconstruction errors across a wide range of under sampling ratios when solving compressed sensing, inpainting, and super-resolution problems.