Predicting the Transition from Short-term to Long-term Memory based on Deep Neural Network

TL;DR

This study demonstrates that EEG signals during short-term memory tasks can be used with deep neural networks to predict long-term memory, potentially aiding learning and cognitive impairment interventions.

Contribution

The paper introduces a novel approach using deep neural networks to predict long-term memory from EEG signals recorded during short-term memory tasks.

Findings

CNN achieved a kappa-value of 0.19 for picture memory

MLP achieved a kappa-value of 0.32 for location memory

Long-term memory prediction from EEG signals is feasible

Abstract

Memory is an essential element in people's daily life based on experience. So far, many studies have analyzed electroencephalogram (EEG) signals at encoding to predict later remembered items, but few studies have predicted long-term memory only with EEG signals of successful short-term memory. Therefore, we aim to predict long-term memory using deep neural networks. In specific, the spectral power of the EEG signals of remembered items in short-term memory was calculated and inputted to the multilayer perceptron (MLP) and convolutional neural network (CNN) classifiers to predict long-term memory. Seventeen participants performed visuo-spatial memory task consisting of picture and location memory in the order of encoding, immediate retrieval (short-term memory), and delayed retrieval (long-term memory). We applied leave-one-subject-out cross-validation to evaluate the predictive models. As a result, the picture memory showed the highest kappa-value of 0.19 on CNN, and location memory showed the highest kappa-value of 0.32 in MLP. These results showed that long-term memory can be predicted with measured EEG signals during short-term memory, which improves learning efficiency and helps people with memory and cognitive impairments.