DRM-IR: Task-Adaptive Deep Unfolding Network for All-In-One Image Restoration

TL;DR

This paper introduces DRM-IR, a flexible and interpretable deep unfolding network that dynamically models various image degradations for improved All-In-One image restoration performance.

Contribution

It proposes a novel task-adaptive degradation modeling framework with a reference-based MAP inference and a degradation prior transmitter for enhanced flexibility and interpretability.

Findings

Achieves state-of-the-art results on multiple benchmarks.

Effectively models diverse degradation types.

Demonstrates superior restoration quality.

Abstract

Existing All-In-One image restoration (IR) methods usually lack flexible modeling on various types of degradation, thus impeding the restoration performance. To achieve All-In-One IR with higher task dexterity, this work proposes an efficient Dynamic Reference Modeling paradigm (DRM-IR), which consists of task-adaptive degradation modeling and model-based image restoring. Specifically, these two subtasks are formalized as a pair of entangled reference-based maximum a posteriori (MAP) inferences, which are optimized synchronously in an unfolding-based manner. With the two cascaded subtasks, DRM-IR first dynamically models the task-specific degradation based on a reference image pair and further restores the image with the collected degradation statistics. Besides, to bridge the semantic gap between the reference and target degraded images, we further devise a Degradation Prior Transmitter (DPT) that restrains the instance-specific feature differences. DRM-IR explicitly provides superior flexibility for All-in-One IR while being interpretable. Extensive experiments on multiple benchmark datasets show that our DRM-IR achieves state-of-the-art in All-In-One IR.