The Best of Both Worlds: a Framework for Combining Degradation Prediction with High Performance Super-Resolution Networks

TL;DR

This paper introduces a versatile framework that combines degradation prediction with high-performance super-resolution networks, leading to improved image quality by leveraging the strengths of both approaches.

Contribution

It presents a novel framework that integrates any blind degradation prediction method with advanced SR networks using a metadata insertion block.

Findings

Hybrid models outperform non-blind and blind counterparts

State-of-the-art prediction schemes enhance SR performance

Framework is robust against complex degradation pipelines

Abstract

To date, the best-performing blind super-resolution (SR) techniques follow one of two paradigms: A) generate and train a standard SR network on synthetic low-resolution - high-resolution (LR - HR) pairs or B) attempt to predict the degradations an LR image has suffered and use these to inform a customised SR network. Despite significant progress, subscribers to the former miss out on useful degradation information that could be used to improve the SR process. On the other hand, followers of the latter rely on weaker SR networks, which are significantly outperformed by the latest architectural advancements. In this work, we present a framework for combining any blind SR prediction mechanism with any deep SR network, using a metadata insertion block to insert prediction vectors into SR network feature maps. Through comprehensive testing, we prove that state-of-the-art contrastive and iterative prediction schemes can be successfully combined with high-performance SR networks such as RCAN and HAN within our framework. We show that our hybrid models consistently achieve stronger SR performance than both their non-blind and blind counterparts. Furthermore, we demonstrate our framework's robustness by predicting degradations and super-resolving images from a complex pipeline of blurring, noise and compression.