AI-Driven Innovations in Volumetric Video Streaming: A Review

TL;DR

This review paper discusses recent AI-driven techniques that address the challenges of transmitting and rendering volumetric video, aiming to improve its efficiency and facilitate widespread adoption in immersive applications.

Contribution

It provides a comprehensive overview of recent AI-based methods for volumetric video streaming and suggests future research directions.

Findings

AI techniques improve data compression and transmission efficiency.

Enhanced rendering methods increase visual quality of volumetric content.

Current approaches enable more practical deployment of volumetric video.

Abstract

Recent efforts to enhance immersive and interactive user experiences have driven the development of volumetric video, a form of 3D content that enables 6 DoF. Unlike traditional 2D content, volumetric content can be represented in various ways, such as point clouds, meshes, or neural representations. However, due to its complex structure and large amounts of data size, deploying this new form of 3D data presents significant challenges in transmission and rendering. These challenges have hindered the widespread adoption of volumetric video in daily applications. In recent years, researchers have proposed various AI-driven techniques to address these challenges and improve the efficiency and quality of volumetric content streaming. This paper provides a comprehensive overview of recent advances in AI-driven approaches to facilitate volumetric content streaming. Through this review, we aim to offer insights into the current state-of-the-art and suggest potential future directions for advancing the deployment of volumetric video streaming in real-world applications.