Integration of Communication and Computational Imaging

TL;DR

This paper introduces a novel framework that integrates communication and computational imaging to enhance remote visual perception, achieving higher robustness, better data compression, and real-time hyperspectral video transmission over long distances.

Contribution

The proposed ICCI framework uniquely combines sensing and transmitting processes for improved efficiency and robustness in remote perception tasks.

Findings

ICCI outperforms sequential schemes in robustness and data compression.

Achieved 80 km hyperspectral video transmission at 30 fps.

Demonstrated enhanced performance in real-time computer vision tasks.

Abstract

Communication enables the expansion of human visual perception beyond the limitations of time and distance, while computational imaging overcomes the constraints of depth and breadth. Although impressive achievements have been witnessed with the two types of technologies, the occlusive information flow between the two domains is a bottleneck hindering their ulterior progression. Herein, we propose a novel framework that integrates communication and computational imaging (ICCI) to break through the inherent isolation between communication and computational imaging for remote perception. By jointly considering the sensing and transmitting of remote visual information, the ICCI framework performs a full-link information transfer optimization, aiming to minimize information loss from the generation of the information source to the execution of the final vision tasks. We conduct numerical analysis and experiments to demonstrate the ICCI framework by integrating communication systems and snapshot compressive imaging systems. Compared with straightforward combination schemes, which sequentially execute sensing and transmitting, the ICCI scheme shows greater robustness against channel noise and impairments while achieving higher data compression. Moreover, an 80 km 27-band hyperspectral video perception with a rate of 30 fps is experimentally achieved. This new ICCI remote perception paradigm offers a highefficiency solution for various real-time computer vision tasks.