Hierarchical Visual Interface for Lecture Video Retrieval and Summarization

TL;DR

This paper introduces a hierarchical visual interface designed to improve the retrieval and summarization of lecture videos, enabling users to explore educational content efficiently through layered summaries and visual cues.

Contribution

It presents a novel hierarchical interface that integrates multi-layered video summaries and retrieval methods, enhancing user experience and accuracy in accessing lecture videos.

Findings

High retrieval accuracy achieved

Enhanced user experience confirmed by user study

Effective exploration of lecture videos through layered summaries

Abstract

With the emergence of large-scale open online courses and online academic conferences, it has become increasingly feasible and convenient to access online educational resources. However, it is time consuming and challenging to effectively retrieve and present numerous lecture videos for common users. In this work, we propose a hierarchical visual interface for retrieving and summarizing lecture videos. Users can utilize the proposed interface to effectively explore the required video information through the results of the video summary generation in different layers. We retrieve the input keywords with the corresponding video layer with timestamps, a frame layer with slides, and the poster layer with summarization of the lecture videos. We verified the proposed interface with our user study by comparing it with other conventional interfaces. The results from our user study confirmed that the proposed interface can achieve high retrieval accuracy and good user experience.see video here https://www.youtube.com/watch?v=zrnejwsOVpc .