Generative AI-aided Joint Training-free Secure Semantic Communications via Multi-modal Prompts
Hongyang Du, Guangyuan Liu, Dusit Niyato, Jiayi Zhang, Jiawen Kang,, Zehui Xiong, Bo Ai, and Dong In Kim

TL;DR
This paper proposes a secure semantic communication system leveraging generative AI and multi-modal prompts to reduce training overhead, improve decoding accuracy, and enhance security through covert communication techniques.
Contribution
It introduces a novel GAI-aided SemCom framework with multi-model prompts and a secure transmission scheme using friendly jammers, addressing training complexity and security issues.
Findings
Effective content decoding with limited semantic prompts
Enhanced security via covert communication with jamming
Stable message reconstruction despite GAI output variability
Abstract
Semantic communication (SemCom) holds promise for reducing network resource consumption while achieving the communications goal. However, the computational overheads in jointly training semantic encoders and decoders-and the subsequent deployment in network devices-are overlooked. Recent advances in Generative artificial intelligence (GAI) offer a potential solution. The robust learning abilities of GAI models indicate that semantic decoders can reconstruct source messages using a limited amount of semantic information, e.g., prompts, without joint training with the semantic encoder. A notable challenge, however, is the instability introduced by GAI's diverse generation ability. This instability, evident in outputs like text-generated images, limits the direct application of GAI in scenarios demanding accurate message recovery, such as face image transmission. To solve the above…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsDigital Media Forensic Detection · Generative Adversarial Networks and Image Synthesis · Face recognition and analysis
MethodsDiffusion
