Guaranteed Image Classification via Goal-oriented Joint Semantic Source and Channel Coding

TL;DR

This paper introduces a goal-oriented joint semantic source and channel coding framework that allocates resources based on image region importance, significantly improving classification reliability over traditional methods.

Contribution

It proposes a novel semantic importance-based coding scheme for image classification that dynamically allocates compression and protection, outperforming uniform coding approaches.

Findings

Classification probability increased by 2.70 times.

Transmission cost reduced by 38%.

Coding efficiency improved by 5.91 times.

Abstract

To enable critical applications such as remote diagnostics, image classification must be guaranteed under bandwidth constraints and unreliable wireless channels through joint source and channel coding (JSCC) design. However, most existing JSCC methods focus on minimizing image distortion, implicitly assuming that all image regions contribute equally to classification performance, thereby overlooking their varying importance for the task. In this paper, we propose a goal-oriented joint semantic source and channel coding (G-JSSCC) framework that applies \emph{various} levels of source coding compression and channel coding protection across image regions based on their semantic importance. Specifically, we design a semantic information extraction method that identifies and ranks various image regions based on their contributions to classification, where the contribution is measured by the shapely value from explainable artificial intelligence (AI). Based on that, we design a semantic source coding and a semantic channel coding method, which allocates higher-quality compression and stronger error protection to image regions of great semantic importance. In addition, we define a new metric, termed coding efficiency, to evaluate the effectiveness of the source and channel coding in the classification task. Simulations show that our proposed G-JSSCC framework improves classification probability by 2.70 times, reduces transmission cost by 38%, and enhances coding efficiency by 5.91 times, compared to the benchmark scheme using uniform compression and an idealized channel code to uniformly protect the whole image.