Syst\`emes interactifs sensibles aux \'emotions : architecture logicielle

TL;DR

This paper presents a software architecture for interactive systems that incorporate user emotions, demonstrated through a ballet dance application where emotions are captured, analyzed, and used to generate stage graphics.

Contribution

It extends the PAC-Amodeus model with an emotion processing branch, enabling emotion-aware interaction in multimedia applications.

Findings

Architecture effectively captures and interprets emotions from ballet dancers.

Emotion-driven outputs enhance interactive multimedia experiences.

The model supports real-time emotion analysis and response.

Abstract

We propose a software architecture for interactive systems which allows integrating the user's emotion. Emotion can be involved in interaction at several levels. In our application case - ballet dance - emotions is explicitely manipulated by the interactive system to produce emotion-wise output. Our architecture model to develop emotion-wise applications is based on the PAC-Amodeus model. We add a branch to this model, divided into three components: Data capture, analysis and cue extraction, and finally interpretation of those cues. We show the different data flows between this architecture's components depending on the entry point of the emotion branch within the system. We then illustrate our model by describing our application case: capturing a ballet dancer's movement to extract the emotions he expresses and use these emotions to generate graphical content that is displayed on stage.