Semantic Communication-Enabled Cloud-Edge-End-collaborative Metaverse Services Architecure

TL;DR

This paper introduces a semantic communication architecture for the metaverse that significantly reduces transmission delay and improves image quality by transmitting key semantic information instead of raw data, enabling more immersive experiences.

Contribution

It proposes the SC-CEE-Meta architecture that leverages semantic modules on VR devices and edge servers to optimize data transmission and processing for immersive metaverse services.

Findings

Reduced wireless transmission delay by 96.05%

Improved image quality by 43.99% under poor channel conditions

Effective semantic transmission in VR enhances user experience

Abstract

With technology advancing and the pursuit of new audiovisual experiences strengthening, the metaverse has gained surging enthusiasm. However, it faces practical hurdles as substantial data like high-resolution virtual scenes must be transmitted between cloud platforms and VR devices. Specifically, the VR device's wireless transmission hampered by insufficient bandwidth, causes speed and delay problems. Meanwhile, poor channel quality leads to data errors and worsens user experience. To solve this, we've proposed the Semantic Communication-Enabled Cloud-Edge-End Collaborative Immersive Metaverse Service (SC-CEE-Meta) Architecture, which includes three modules: VR video semantic transmission, video synthesis, and 3D virtual scene reconstruction. By deploying semantic modules on VR devices and edge servers and sending key semantic info instead of focusing on bit-level reconstruction, it can cut latency, resolve the resource-bandwidth conflict, and better withstand channel interference. Also, the cloud deploys video synthesis and 3D scene reconstruction preprocessing, while edge devices host 3D reconstruction rendering modules, all for immersive services. Verified on Meta Quest Pro, the SC-CEE-Meta can reduce wireless transmission delay by 96.05\% and boost image quality by 43.99\% under poor channel condition.