# I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue

## TL;DR

This paper introduces a novel architecture for Spoken Dialogue Systems that predicts users' future emotional reactions and laughter, enabling more human-like, anticipatory interactions by analyzing current behaviors and dialogue cues.

## Contribution

It presents a new predictive framework for SDSs to anticipate future affective responses, incorporating emotion and laughter prediction based on current system behaviors.

## Key findings

- Preliminary analysis shows emotion and laughter synchronicity in human-robot dialogue.
- The architecture can predict future user emotions and laughter types.
- Evidence of DA-emotion causality supports anticipatory dialogue capabilities.

## Abstract

Current Spoken Dialogue Systems (SDSs) often serve as passive listeners that respond only after receiving user speech. To achieve human-like dialogue, we propose a novel future prediction architecture that allows an SDS to anticipate future affective reactions based on its current behaviors before the user speaks. In this work, we investigate two scenarios: speech and laughter. In speech, we propose to predict the user's future emotion based on its temporal relationship with the system's current emotion and its causal relationship with the system's current Dialogue Act (DA). In laughter, we propose to predict the occurrence and type of the user's laughter using the system's laughter behaviors in the current turn. Preliminary analysis of human-robot dialogue demonstrated synchronicity in the emotions and laughter displayed by the human and robot, as well as DA-emotion causality in their dialogue. This verifies that our architecture can contribute to the development of an anticipatory SDS.