Generative AI for Immersive Communication: The Next Frontier in Internet-of-Senses Through 6G

TL;DR

This paper discusses how generative AI can enable immersive multi-sensory communication in the future Internet-of-Senses, highlighting significant bandwidth reduction and addressing key technical challenges for 6G networks.

Contribution

It introduces a novel use case leveraging semantic communication with generative AI that drastically reduces bandwidth for immersive media, advancing the development of the Internet of Senses.

Findings

Bandwidth consumption reduced by 99.93% using the proposed scheme.

Demonstrates potential for high-throughput, low-latency immersive media.

Addresses synchronization and robustness challenges in multi-sensory communication.

Abstract

Over the past two decades, the Internet-of-Things (IoT) has become a transformative concept, and as we approach 2030, a new paradigm known as the Internet of Senses (IoS) is emerging. Unlike conventional Virtual Reality (VR), IoS seeks to provide multi-sensory experiences, acknowledging that in our physical reality, our perception extends far beyond just sight and sound; it encompasses a range of senses. This article explores the existing technologies driving immersive multi-sensory media, delving into their capabilities and potential applications. This exploration includes a comparative analysis between conventional immersive media streaming and a proposed use case that leverages semantic communication empowered by generative Artificial Intelligence (AI). The focal point of this analysis is the substantial reduction in bandwidth consumption by 99.93% in the proposed scheme. Through this comparison, we aim to underscore the practical applications of generative AI for immersive media. Concurrently addressing major challenges in this field, such as temporal synchronization of multiple media, ensuring high throughput, minimizing the End-to-End (E2E) latency, and robustness to low bandwidth while outlining future trajectories.