M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Experts

TL;DR

M2IR introduces a proactive image restoration framework combining pixel-wise modulation and mixture-of-experts to suppress degradations during encoding and eliminate residuals during decoding, improving adaptability and detail preservation.

Contribution

The paper presents M2IR, a novel proactive restoration framework with Mamba-Style Transformer and degradation-specific experts, advancing beyond reactive Transformer-based methods.

Findings

Outperforms existing methods on multiple benchmarks.

Enhances generalization and adaptability in diverse restoration tasks.

Achieves superior detail recovery across various degradations.

Abstract

While Transformer-based architectures have dominated recent advances in all-in-one image restoration, they remain fundamentally reactive: propagating degradations rather than proactively suppressing them. In the absence of explicit suppression mechanisms, degraded signals interfere with feature learning, compelling the decoder to balance artifact removal and detail preservation, thereby increasing model complexity and limiting adaptability. To address these challenges, we propose M2IR, a novel restoration framework that proactively regulates degradation propagation during the encoding stage and efficiently eliminates residual degradations during decoding. Specifically, the Mamba-Style Transformer (MST) block performs pixel-wise selective state modulation to mitigate degradations while preserving structural integrity. In parallel, the Adaptive Degradation Expert Collaboration (ADEC) module utilizes degradation-specific experts guided by a DA-CLIP-driven router and complemented by a shared expert to eliminate residual degradations through targeted and cooperative restoration. By integrating the MST block and ADEC module, M2IR transitions from passive reaction to active degradation control, effectively harnessing learned representations to achieve superior generalization, enhanced adaptability, and refined recovery of fine-grained details across diverse all-in-one image restoration benchmarks. Our source codes are available at https://github.com/Im34v/M2IR.