DRCAS: Deep Restoration Network for Hardware Based Compressive Acquisition Scheme

TL;DR

This paper introduces HCAS, a hardware-based compressed image acquisition scheme, and DRCAS, a deep neural network for image restoration, achieving high compression, power savings, and improved image quality over existing methods.

Contribution

The paper presents the first deep learning-based restoration network specifically designed for images acquired via hardware-based compression schemes like HCAS.

Findings

HCAS achieves higher compression ratios and is hardware-friendly.

DRCAS outperforms state-of-the-art super resolution networks in quality and size.

The combined approach enables simpler, power-efficient image acquisition pipelines.

Abstract

We investigate the power and performance improvement in image acquisition devices by the use of CAS (Compressed Acquisition Scheme) and DNN (Deep Neural Networks). Towards this end, we propose a novel image acquisition scheme HCAS (Hardware based Compressed Acquisition Scheme) using hardware-based binning (downsampling), bit truncation and JPEG compression and develop a deep learning based reconstruction network for images acquired using the same. HCAS is motivated by the fact that in-situ compression of raw data using binning and bit truncation results in reduction in data traffic and power in the entire downstream image processing pipeline and additional compression of processed data using JPEG will help in storage/transmission of images. The combination of in-situ compression with JPEG leads to high compression ratios, significant power savings with further advantages of image acquisition simplification. Bearing these concerns in mind, we propose DRCAS (Deep Restoration network for hardware based Compressed Acquisition Scheme), which to our best knowledge, is the first work proposed in the literature for restoration of images acquired using acquisition scheme like HCAS. When compared with the CAS methods (bicubic downsampling) used in super resolution tasks in literature, HCAS proposed in this paper performs superior in terms of both compression ratio and being hardware friendly. The restoration network DRCAS also perform superior than state-of-the-art super resolution networks while being much smaller. Thus HCAS and DRCAS technique will enable us to design much simpler and power efficient image acquisition pipelines.