py360tool: Um framework para manipula\c{c}\~ao de v\'ideo 360$^\circ$ com ladrilhos

TL;DR

py360tools is a Python library designed to simplify the handling, simulation, and analysis of tile-based 360-degree video streaming, aiding in optimizing VR experiences and evaluating quality metrics.

Contribution

It introduces a flexible, automated tool for client-side processing and analysis of 360° video streaming, addressing complexity and reproducibility challenges.

Findings

Automates spherical projection reconstruction and viewport extraction.

Facilitates simulation of tile-based streaming sessions.

Enables analysis of different projections and tiling strategies.

Abstract

The streaming of 360$^\circ$ videos is one of the most bandwidth-demanding virtual reality (VR) applications, as the video must be encoded in ultra-high resolution to ensure an immersive experience. To optimize its transmission, current approaches partition the spherical video into tiles, which are encoded at different bitrates and selectively delivered, based on the viewing direction of the user (viewport). The complexity of this architecture, which involves viewport prediction, tile selection, bit rate adaptation, and handling of parallel streaming, requires new tools to evaluate quality of experience (QoE) and quality of service (QoS), especially due to its interactive nature and low reproducibility. This work introduces py360tools, a Python library to handle tile-based 360$^\circ$ video streaming. The library automates key client-side tasks, such as spherical projection reconstruction, viewport extraction, and tile selection, facilitating the playback and simulation of streaming sessions. Furthermore, py360tools offers a flexible architecture, enabling efficient analysis of different projections and tiling strategies.