A Human-Annotated Video Dataset for Training and Evaluation of 360-Degree Video Summarization Methods

TL;DR

This paper introduces a new human-annotated dataset for 360-degree video summarization, enabling training and evaluation of methods that convert immersive videos into concise 2D summaries for common devices.

Contribution

The paper provides a novel dataset with ground-truth summaries for 360-degree videos and evaluates existing 2D-video summarization methods on this new data.

Findings

State-of-the-art methods serve as baselines for 360-degree video summarization.

The dataset supports training and objective evaluation of summarization algorithms.

An interactive annotation tool was developed to facilitate data creation.

Abstract

In this paper we introduce a new dataset for 360-degree video summarization: the transformation of 360-degree video content to concise 2D-video summaries that can be consumed via traditional devices, such as TV sets and smartphones. The dataset includes ground-truth human-generated summaries, that can be used for training and objectively evaluating 360-degree video summarization methods. Using this dataset, we train and assess two state-of-the-art summarization methods that were originally proposed for 2D-video summarization, to serve as a baseline for future comparisons with summarization methods that are specifically tailored to 360-degree video. Finally, we present an interactive tool that was developed to facilitate the data annotation process and can assist other annotation activities that rely on video fragment selection.