Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming

TL;DR

This survey comprehensively reviews the current state of XR streaming, covering technical paradigms, traffic characteristics, quality factors, optimization techniques, and future challenges in immersive multimedia communication.

Contribution

It provides a detailed overview of XR streaming technologies, introduces multimodal interaction methods, and discusses optimization strategies and challenges for future research.

Findings

XR traffic has unique data transmission requirements

Visual attention-based methods improve XR streaming efficiency

Identifies key challenges and future directions in XR content delivery

Abstract

Extended reality (XR) is rapidly advancing, and poised to revolutionize content creation and consumption. In XR, users integrate various sensory inputs to form a cohesive perception of the virtual environment. This survey reviews the state-of-the-art in XR streaming, focusing on multiple paradigms. To begin, we define XR and introduce various XR headsets along with their multimodal interaction methods to provide a foundational understanding. We then analyze XR traffic characteristics to highlight the unique data transmission requirements. We also explore factors that influence the quality of experience in XR systems, aiming to identify key elements for enhancing user satisfaction. Following this, we present visual attention-based optimization methods for XR streaming to improve efficiency and performance. Finally, we examine current applications and highlight challenges to provide insights into ongoing and future developments of XR.