Convolutional versus Self-Organized Operational Neural Networks for Real-World Blind Image Denoising

TL;DR

This paper demonstrates that deep Self-Organized Operational Neural Networks outperform traditional CNNs in real-world blind image denoising, achieving higher PSNR with fewer layers and less computational cost.

Contribution

First application of deep Self-ONNs to real-world blind image denoising, showing superior performance over CNNs with reduced complexity.

Findings

Self-ONNs outperform CNNs in PSNR by up to 1.76dB.

Deep Self-ONNs with fewer layers achieve comparable or better results.

Self-ONNs require less computational resources than CNN counterparts.

Abstract

Real-world blind denoising poses a unique image restoration challenge due to the non-deterministic nature of the underlying noise distribution. Prevalent discriminative networks trained on synthetic noise models have been shown to generalize poorly to real-world noisy images. While curating real-world noisy images and improving ground truth estimation procedures remain key points of interest, a potential research direction is to explore extensions to the widely used convolutional neuron model to enable better generalization with fewer data and lower network complexity, as opposed to simply using deeper Convolutional Neural Networks (CNNs). Operational Neural Networks (ONNs) and their recent variant, Self-organized ONNs (Self-ONNs), propose to embed enhanced non-linearity into the neuron model and have been shown to outperform CNNs across a variety of regression tasks. However, all such comparisons have been made for compact networks and the efficacy of deploying operational layers as a drop-in replacement for convolutional layers in contemporary deep architectures remains to be seen. In this work, we tackle the real-world blind image denoising problem by employing, for the first time, a deep Self-ONN. Extensive quantitative and qualitative evaluations spanning multiple metrics and four high-resolution real-world noisy image datasets against the state-of-the-art deep CNN network, DnCNN, reveal that deep Self-ONNs consistently achieve superior results with performance gains of up to 1.76dB in PSNR. Furthermore, Self-ONNs with half and even quarter the number of layers that require only a fraction of computational resources as that of DnCNN can still achieve similar or better results compared to the state-of-the-art.