MDVSC -- Wireless Model Division Video Semantic Communication

TL;DR

This paper presents MDVSC, a wireless video semantic communication method that leverages model division and deep joint source-channel coding to efficiently transmit video over noisy channels with controllable data size.

Contribution

It introduces a novel semantic communication framework combining model division multiple access and deep JSCC with entropy-based variable length coding for wireless video transmission.

Findings

MDVSC outperforms traditional wireless video coding in quality metrics.

The method enables precise control of code length.

Experimental results validate its effectiveness and adaptability.

Abstract

This paper introduces a novel method for transmitting video data over noisy wireless channels with high efficiency and controllability. The method derivates from model division multiple access (MDMA) to extract common semantic features from video frames. It also uses deep joint source-channel coding (JSCC) as the main framework to establish communication links and deal with channel noise. An entropy-based variable length coding scheme is developed to adjust the data amount accurately and explicitly. We name our method as model division video semantic communication (MDVSC). The main steps of our approach are as follows: first, video frames are transformed into a latent space to reduce computational complexity and redistribute data. Then, common features and individual features are extracted, and variable length coding is applied to further eliminate redundant semantic information under the communication bandwidth constraint. We evaluate our method on standard video test sequences and compare it with traditional wireless video coding methods. The results show that MDVSC generally surpasses the conventional methods in terms of quality metrics and has the capability to control code length precisely. Moreover, additional experiments and ablation studies are conducted to demonstrate its potential for various tasks.