Memories in the Making: Predicting Video Memorability with Encoding Phase EEG

TL;DR

This study uses EEG signals transformed into visual data and deep learning to identify neural signatures of memorable moments in videos, highlighting the role of theta oscillations and a specific encoding phase.

Contribution

It introduces a novel approach combining EEG scaleograms and deep learning to predict video memorability and identifies neural markers associated with memorable moments.

Findings

Theta band oscillations over the right temporal lobe are involved in memory encoding.

A distinct neural signature correlates with moments of high memorability.

Deep learning models can predict recognition of videos based on encoding EEG signals.

Abstract

In a world of ephemeral moments, our brain diligently sieves through a cascade of experiences, like a skilled gold prospector searching for precious nuggets amidst the river's relentless flow. This study delves into the elusive "moment of memorability" -- a fleeting, yet vital instant where experiences are prioritised for consolidation in our memory. By transforming subjects' encoding phase electroencephalography (EEG) signals into the visual domain using scaleograms and leveraging deep learning techniques, we investigate the neural signatures that underpin this moment, with the aim of predicting subject-specific recognition of video. Our findings not only support the involvement of theta band (4-8Hz) oscillations over the right temporal lobe in the encoding of declarative memory, but also support the existence of a distinct moment of memorability, akin to the gold nuggets that define our personal river of experiences.