Mirage: Transmitting a Video as a Perceptual Illusion for 50,000X Speedup

TL;DR

Mirage is a novel video transmission framework that transmits semantic representations instead of raw video data, achieving up to 50,000 times faster transmission while preserving perceptual quality and privacy.

Contribution

The paper introduces Mirage, a semantic-based video transmission method that significantly reduces bandwidth and enhances privacy by transmitting only high-level representations.

Findings

Achieves up to 50,000X data compression speedup.

Maintains perceptual video quality through generative synthesis.

Supports personalized and flexible deployment scenarios.

Abstract

The existing communication framework mainly aims at accurate reconstruction of source signals to ensure reliable transmission. However, this signal-level fidelity-oriented design often incurs high communication overhead and system complexity, particularly in video communication scenarios where mainstream frameworks rely on transmitting visual data itself, resulting in significant bandwidth consumption. To address this issue, we propose a visual data-free communication framework, Mirage, for extremely efficient video transmission while preserving semantic information. Mirage decomposes video content into two complementary components: temporal sequence information capturing motion dynamics and spatial appearance representations describing overall visual structure. Temporal information is preserved through video captioning, while key frames are encoded into compact semantic representations for spatial appearance. These representations are transmitted to the receiver, where videos are synthesized using generative video models. Since no raw visual data is transmitted, Mirage is inherently privacy-preserving. Mirage also supports personalized adaptation across deployment scenarios. The sender, network, and receiver can independently impose constraints on semantic representation, transmission, and generation, enabling flexible trade-offs between efficiency, privacy, control, and perceptual quality. Experimental results in video transmission demonstrate that Mirage achieves up to a 50000X data-level compression speedup over raw video transmission, with gains expected to scale with larger video content sizes.