Meaning over Motion: A Semantic-First Approach to 360{\deg} Viewport Prediction

TL;DR

This paper introduces a semantic-aware viewport prediction framework for 360-degree video streaming that anticipates rapid attention shifts by integrating cognitive intent, significantly reducing stalls and bandwidth use.

Contribution

It presents a novel semantic-first approach with server-side reasoning and client-side control, overcoming the limitations of kinematic-based methods in viewport prediction.

Findings

Reduces stall duration by at least 20%

Lowers bandwidth consumption by at least 18%

Mitigates the Saccade Trap in viewport prediction

Abstract

Ultra-high-resolution 360-degree video streaming is severely constrained by the massive bandwidth required to deliver immersive experiences. Current viewport prediction techniques predominately rely on kinematics or low-level visual saliency, treating users as passive physical objects governed by inertia. This theoretical limitation leads to the "Saccade Trap" -- a critical failure mode where predictors fail to anticipate rapid, meaning-driven shifts in attention, causing rebuffering stalls exactly when user engagement is highest. To resolve this, we propose Semantically-Adaptive Conformal Tiling with Associative Lookahead, a novel framework that integrates cognitive intent into network control. Unlike "one-size-fits-all" approaches, our method utilizes an architectural inversion strategy: heavy semantic reasoning is offloaded to the server to generate lightweight association graphs, which guide a low-latency client-side controller. We construct a personalized Multi-Modal Prediction Set that dynamically tightens safety margins during stable fixation to maximize efficiency, while simultaneously pre-fetching non-adjacent tiles containing semantically linked objects (Associative Lookahead). This mechanism effectively converts the "calm" of fixation into a preparation phase for the next interaction. Trace-driven evaluation on the 360-AV-HM dataset demonstrates that this approach successfully mitigates the Saccade Trap, reducing stall duration by $\ge$ 20% and lowering effective bandwidth consumption by $\ge$ 18% compared to state-of-the-art trajectory-based baselines.