Using Saliency and Cropping to Improve Video Memorability

TL;DR

This paper explores how saliency-based cropping techniques, both fixed and dynamic, can enhance the memorability of videos, especially those with initially low memorability scores.

Contribution

It introduces a novel approach using saliency-guided cropping to improve video memorability, including dynamic cropping that adapts during video playback.

Findings

Saliency-based cropping improves video memorability.

Dynamic cropping yields better results than fixed cropping.

Low-memorability videos benefit most from the method.

Abstract

Video memorability is a measure of how likely a particular video is to be remembered by a viewer when that viewer has no emotional connection with the video content. It is an important characteristic as videos that are more memorable are more likely to be shared, viewed, and discussed. This paper presents results of a series of experiments where we improved the memorability of a video by selectively cropping frames based on image saliency. We present results of a basic fixed cropping as well as the results from dynamic cropping where both the size of the crop and the position of the crop within the frame, move as the video is played and saliency is tracked. Our results indicate that especially for videos of low initial memorability, the memorability score can be improved.