ERIT Lightweight Multimodal Dataset for Elderly Emotion Recognition and Multimodal Fusion Evaluation

TL;DR

ERIT is a new lightweight multimodal dataset comprising text and images from elderly individuals' reactions, aimed at advancing emotion recognition and multimodal fusion research in this underrepresented age group.

Contribution

It introduces a novel multimodal dataset specifically for elderly emotion recognition, enabling research in lightweight neural multimodal fusion techniques.

Findings

Dataset validated through comprehensive experiments.

Facilitates research on emotion recognition in elderly.

Supports development of lightweight multimodal fusion models.

Abstract

ERIT is a novel multimodal dataset designed to facilitate research in a lightweight multimodal fusion. It contains text and image data collected from videos of elderly individuals reacting to various situations, as well as seven emotion labels for each data sample. Because of the use of labeled images of elderly users reacting emotionally, it is also facilitating research on emotion recognition in an underrepresented age group in machine learning visual emotion recognition. The dataset is validated through comprehensive experiments indicating its importance in neural multimodal fusion research.