Beyond Joint Demosaicking and Denoising: An Image Processing Pipeline for a Pixel-bin Image Sensor
SMA Sharif, and Rizwan Ali Naqvi, and Mithun Biswas

TL;DR
This paper introduces a novel deep learning-based image processing pipeline designed for pixel-bin image sensors, effectively addressing joint demosaicing and denoising challenges to improve smartphone camera image quality.
Contribution
It presents a new learning-based method utilizing attention mechanisms and perceptual losses, specifically tailored for non-Bayer CFA patterns in pixel-bin sensors, advancing image reconstruction techniques.
Findings
Outperforms existing methods in qualitative assessments
Achieves higher quantitative accuracy in image reconstruction
Enhances visual plausibility of processed images
Abstract
Pixel binning is considered one of the most prominent solutions to tackle the hardware limitation of smartphone cameras. Despite numerous advantages, such an image sensor has to appropriate an artefact-prone non-Bayer colour filter array (CFA) to enable the binning capability. Contrarily, performing essential image signal processing (ISP) tasks like demosaicking and denoising, explicitly with such CFA patterns, makes the reconstruction process notably complicated. In this paper, we tackle the challenges of joint demosaicing and denoising (JDD) on such an image sensor by introducing a novel learning-based method. The proposed method leverages the depth and spatial attention in a deep network. The proposed network is guided by a multi-term objective function, including two novel perceptual losses to produce visually plausible images. On top of that, we stretch the proposed image…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage and Signal Denoising Methods · Advanced Image Fusion Techniques · Image Enhancement Techniques
