ElasticPlay: Interactive Video Summarization with Dynamic Time Budgets
Haojian Jin, Yale Song, Koji Yatani

TL;DR
ElasticPlay is an interactive video summarization system that allows users to control the summarization process with real-time feedback, combining advanced algorithms and direct manipulation to improve user experience and summarization quality.
Contribution
We introduce ElasticPlay, a novel mixed-initiative system enabling users to dynamically control video summaries through an interactive interface and real-time algorithmic updates.
Findings
Outperforms existing techniques on TVSum50 dataset
Participants responded favorably in lab and deployment studies
Enables fine-tuned video summarization with immediate feedback
Abstract
Video consumption is being shifted from sit-and-watch to selective skimming. Existing video player interfaces, however, only provide indirect manipulation to support this emerging behavior. Video summarization alleviates this issue to some extent, shortening a video based on the desired length of a summary as an input variable. But an optimal length of a summarized video is often not available in advance. Moreover, the user cannot edit the summary once it is produced, limiting its practical applications. We argue that video summarization should be an interactive, mixed-initiative process in which users have control over the summarization procedure while algorithms help users achieve their goal via video understanding. In this paper, we introduce ElasticPlay, a mixed-initiative approach that combines an advanced video summarization technique with direct interface manipulation to help…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVideo Analysis and Summarization · Multimedia Communication and Technology · Music and Audio Processing
