Using Saliency and Cropping to Improve Video Memorability
Vaibhav Mudgal, Qingyang Wang, Lorin Sweeney, Alan F. Smeaton

TL;DR
This paper explores how saliency-based cropping techniques, both fixed and dynamic, can enhance the memorability of videos, especially those with initially low memorability scores.
Contribution
It introduces a novel approach using saliency-guided cropping to improve video memorability, including dynamic cropping that adapts during video playback.
Findings
Saliency-based cropping improves video memorability.
Dynamic cropping yields better results than fixed cropping.
Low-memorability videos benefit most from the method.
Abstract
Video memorability is a measure of how likely a particular video is to be remembered by a viewer when that viewer has no emotional connection with the video content. It is an important characteristic as videos that are more memorable are more likely to be shared, viewed, and discussed. This paper presents results of a series of experiments where we improved the memorability of a video by selectively cropping frames based on image saliency. We present results of a basic fixed cropping as well as the results from dynamic cropping where both the size of the crop and the position of the crop within the frame, move as the video is played and saliency is tracked. Our results indicate that especially for videos of low initial memorability, the memorability score can be improved.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVisual Attention and Saliency Detection · Image and Video Quality Assessment · Image Enhancement Techniques
