Semantic Satellite Communications for Synchronized Audiovisual Reconstruction
Fangyu Liu, Peiwen Jiang, Wenjin Wang, Chao-Kai Wen, Xiao Li, Shi Jin

TL;DR
This paper introduces an adaptive semantic transmission system for satellite communications that dynamically switches between audio and video modalities, reducing bandwidth use while maintaining synchronized audiovisual quality.
Contribution
The paper presents a novel dual-stream generative architecture with dynamic keyframe updates and a language model-based decision module for improved satellite audiovisual transmission.
Findings
Significantly reduces bandwidth consumption
Achieves high-fidelity audiovisual synchronization
Enhances robustness in challenging satellite conditions
Abstract
Satellite communications face severe bottlenecks in supporting high-fidelity synchronized audiovisual services, as conventional schemes struggle with cross-modal coherence under fluctuating channel conditions, limited bandwidth, and long propagation delays. To address these limitations, this paper proposes an adaptive multimodal semantic transmission system tailored for satellite scenarios, aiming for high-quality synchronized audiovisual reconstruction under bandwidth constraints. Unlike static schemes with fixed modal priorities, our framework features a dual-stream generative architecture that flexibly switches between video-driven audio generation and audio-driven video generation. This allows the system to dynamically decouple semantics, transmitting only the most important modality while employing cross-modal generation to recover the other. To balance reconstruction quality and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSatellite Communication Systems · Wireless Signal Modulation Classification · Multimedia Communication and Technology
