Developing emotion recognition for video conference software to support people with autism

TL;DR

This paper presents a modular emotion recognition system using neural networks trained on facial landmarks, designed to assist autistic individuals in video conferencing by detecting and displaying emotions.

Contribution

It introduces a flexible, modular emotion recognition software tailored for video conferencing to support autistic users, trained on facial landmark features.

Findings

Successfully detects emotions in real-time video streams.

Modular design allows easy integration with various platforms.

Improves emotion recognition accuracy for autistic users.

Abstract

We develop an emotion recognition software for the use with a video conference software for autistic individuals which are unable to recognize emotions properly. It can get an image out of the video stream, detect the emotion in it with the help of a neural network and display the prediction to the user. The network is trained on facial landmark features. The software is fully modular to support adaption to different video conference software, programming languages and implementations.