PQDynamicISP: Dynamically Controlled Image Signal Processor for Any Image Sensors Pursuing Perceptual Quality

TL;DR

This paper introduces PQDynamicISP, a lightweight, dynamically controlled image signal processor that adapts parameters in real-time for different environments and sensors, achieving high perceptual quality without heavy DNN models.

Contribution

It presents a novel dynamic control mechanism for conventional ISP functions, enabling high-quality image processing adaptable to various sensors and environments.

Findings

Achieves state-of-the-art accuracy on multiple datasets.

Handles different sensors with a single ISP model.

Maintains lightweight design compared to DNN-based ISPs.

Abstract

Full DNN-based image signal processors (ISPs) have been actively studied and have achieved superior image quality compared to conventional ISPs. In contrast to this trend, we propose a lightweight ISP that consists of simple conventional ISP functions but achieves high image quality by increasing expressiveness. Specifically, instead of tuning the parameters of the ISP, we propose to control them dynamically for each environment and even locally. As a result, state-of-the-art accuracy is achieved on various datasets, including other tasks like tone mapping and image enhancement, even though ours is lighter than DNN-based ISPs. Additionally, our method can process different image sensors with a single ISP through dynamic control, whereas conventional methods require training for each sensor.