Comprehensive Examination of Unrolled Networks for Solving Linear Inverse Problems

TL;DR

This paper provides a comprehensive analysis and practical guidelines for designing unrolled neural networks for solving linear inverse problems, aiming to simplify decision-making and improve performance.

Contribution

It unifies methodologies in unrolled networks, conducts an extensive ablation study, and offers practical recommendations to optimize their design and application.

Findings

Reduced the number of design choices in unrolled networks.

Identified key factors impacting network performance.

Provided guidelines for effective unrolled network design.

Abstract

Unrolled networks have become prevalent in various computer vision and imaging tasks. Although they have demonstrated remarkable efficacy in solving specific computer vision and computational imaging tasks, their adaptation to other applications presents considerable challenges. This is primarily due to the multitude of design decisions that practitioners working on new applications must navigate, each potentially affecting the network's overall performance. These decisions include selecting the optimization algorithm, defining the loss function, and determining the number of convolutional layers, among others. Compounding the issue, evaluating each design choice requires time-consuming simulations to train, fine-tune the neural network, and optimize for its performance. As a result, the process of exploring multiple options and identifying the optimal configuration becomes time-consuming and computationally demanding. The main objectives of this paper are (1) to unify some ideas and methodologies used in unrolled networks to reduce the number of design choices a user has to make, and (2) to report a comprehensive ablation study to discuss the impact of each of the choices involved in designing unrolled networks and present practical recommendations based on our findings. We anticipate that this study will help scientists and engineers design unrolled networks for their applications and diagnose problems within their networks efficiently.