Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit

TL;DR

Emolysis is an open-source, multimodal toolkit for automatic group emotion recognition that processes videos to analyze emotions, valence, and arousal, supporting multiple platforms with an intuitive GUI.

Contribution

It introduces Emolysis, a versatile, open-source toolkit for group emotion analysis with multimodal processing and platform support, facilitating research and application development.

Findings

Supports synchronized multimodal emotion analysis from videos

Provides a user-friendly GUI for fine-grained emotion targeting

Available across major mobile and desktop platforms

Abstract

Automatic group emotion recognition plays an important role in understanding complex human-human interaction. This paper introduces, Emolysis, a Python-based, standalone open-source group emotion analysis toolkit for use in different social situations upon getting consent from the users. Given any input video, Emolysis processes synchronized multimodal input and maps it to group level emotion, valence and arousal. Additionally, the toolkit supports major mobile and desktop platforms (Android, iOS, Windows). The Emolysis platform also comes with an intuitive graphical user interface that allows users to select different modalities and target persons for more fine-grained emotion analysis. Emolysis is freely available for academic research and encourages application developers to extend it to application specific environments on top of the existing system. We believe that the extension mechanism is quite straightforward. Our code models and interface are available at https://github.com/ControlNet/emolysis.