PQDynamicISP: Dynamically Controlled Image Signal Processor for Any Image Sensors Pursuing Perceptual Quality
Masakazu Yoshimura, Junji Otsuka, Takeshi Ohashi

TL;DR
This paper introduces PQDynamicISP, a lightweight, dynamically controlled image signal processor that adapts parameters in real-time for different environments and sensors, achieving high perceptual quality without heavy DNN models.
Contribution
It presents a novel dynamic control mechanism for conventional ISP functions, enabling high-quality image processing adaptable to various sensors and environments.
Findings
Achieves state-of-the-art accuracy on multiple datasets.
Handles different sensors with a single ISP model.
Maintains lightweight design compared to DNN-based ISPs.
Abstract
Full DNN-based image signal processors (ISPs) have been actively studied and have achieved superior image quality compared to conventional ISPs. In contrast to this trend, we propose a lightweight ISP that consists of simple conventional ISP functions but achieves high image quality by increasing expressiveness. Specifically, instead of tuning the parameters of the ISP, we propose to control them dynamically for each environment and even locally. As a result, state-of-the-art accuracy is achieved on various datasets, including other tasks like tone mapping and image enhancement, even though ours is lighter than DNN-based ISPs. Additionally, our method can process different image sensors with a single ISP through dynamic control, whereas conventional methods require training for each sensor.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCCD and CMOS Imaging Sensors · Neural Networks and Applications
