Feature Partitioning and Semantic Equalization for Intrinsic Robustness in Semantic Communication under Packet Loss

TL;DR

This paper investigates how feature partitioning affects robustness in semantic communication under packet loss, proposing a Semantic Equalization Mechanism to improve CNN resilience, achieving performance comparable to Transformer architectures.

Contribution

It introduces a Semantic Equalization Mechanism (SEM) for CNNs that balances channel contributions, enhancing robustness against packet loss in semantic communication systems.

Findings

Transformer shows inherent robustness to packet loss when partitioned along channels.

CNN with SEM maintains about 85% PSNR at 40% packet loss.

Balanced semantic representation is key to robustness in semantic communication.

Abstract

Semantic communication can improve transmission efficiency by focusing on task-relevant information. However, under packet-based communication protocols, any error typically results in the loss of an entire packet, making semantic communication particularly vulnerable to packet loss. Since high-dimensional semantic features must be partitioned into one-dimensional transmission units during packetization. A critical open question is how to partition semantic features to maximize robustness. To address this, we systematically investigate the performance of two mainstream architectures, Transformer and Convolutional neural networks (CNN), under various feature partitioning schemes. The results show that the Transformer architecture exhibits inherent robustness to packet loss when partitioned along the channel dimension. In contrast, the CNN-based baseline exhibits imbalanced channel utilization, causing severe degradation once dominant channels are lost. To enhance the CNN resilience, we propose a lightweight Semantic Equalization Mechanism (SEM) that balances channel contributions and prevents a few channels from dominating. SEM consists of two parallel approaches: a Dynamic Scale module that adaptively adjusts channel importance, and a Broadcast module that facilitates information interaction among channels. Experimental results demonstrate that CNN equipped with SEM achieve graceful degradation under packet loss (retaining about 85% of lossless PSNR at 40% packet loss), comparable to that of Transformer models. Our findings indicate that, under an appropriate partitioning strategy, maintaining a balanced semantic representation is a fundamental condition for achieving intrinsic robustness against packet loss. These insights may also extend to other modalities such as video and support practical semantic communication design.