Immersive Media and Massive Twinning: Advancing Towards the Metaverse

TL;DR

This paper discusses how immersive media and advanced communication paradigms are essential for realizing the Metaverse, focusing on 3D data processing, wireless delivery, and new transmission techniques to enable seamless digital-physical twin interactions.

Contribution

It explores the role of various media types, challenges in data handling, and emergent communication paradigms crucial for enabling immersive Metaverse experiences.

Findings

Identifies key media types for Metaverse communication

Highlights challenges in 3D data processing and transmission

Proposes emergent communication paradigms for efficiency

Abstract

The advent of the Metaverse concept has further expedited the evolution of haptic, tactile internet, and multimedia applications with their VR/AR/XR services, and therefore, fully-immersive sensing is most likely to define the next generation of wireless networks as a key to realize the speculative vision of the Metaverse. In this magazine, we articulate different types of media that we envision will be communicated between the cyber and physical twins in the Metaverse. In particular, we explore the advantages grasped by exploiting each kind, and we point out critical challenges pertinent to 3D data processing, coding, transporting, and rendering. We further shed light on the role of future wireless networks in delivering the anticipated quality of immersion through the reliable streaming of multimedia signals between the digital twin and its physical counterpart. Specifically, we explore emergent communication paradigms, including semantic, holographic, and goal-oriented communication, which we expect to realize energy and spectrally efficient Metaverse while ensuring ultra-low latency.