Exploring Global Diversity and Local Context for Video Summarization
Yingchao Pan, Ouhan Huang, Qinghao Ye, Zhongjin Li, Wenjiang Wang,, Guodun Li, Yuxing Chen

TL;DR
This paper introduces SUM-DCA, a novel video summarization model that combines global diverse attention and local contextual attention to produce more diverse and concise video summaries, outperforming existing methods.
Contribution
It proposes a new diversified attention mechanism using Euclidean distance and a local contextual attention to enhance video summarization.
Findings
SUM-DCA achieves higher F-score on benchmark datasets.
The model effectively reduces redundancy in video summaries.
Experiments demonstrate superiority over existing methods.
Abstract
Video summarization aims to automatically generate a diverse and concise summary which is useful in large-scale video processing. Most of the methods tend to adopt self-attention mechanism across video frames, which fails to model the diversity of video frames. To alleviate this problem, we revisit the pairwise similarity measurement in self-attention mechanism and find that the existing inner-product affinity leads to discriminative features rather than diversified features. In light of this phenomenon, we propose global diverse attention which uses the squared Euclidean distance instead to compute the affinities. Moreover, we model the local contextual information by novel local contextual attention to remove the redundancy in the video. By combining these two attention mechanisms, a video SUMmarization model with Diversified Contextual Attention scheme is developed, namely SUM-DCA.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVideo Analysis and Summarization · Music and Audio Processing · Image Retrieval and Classification Techniques
