# REsCUE: A framework for REal-time feedback on behavioral CUEs using multimodal anomaly detection

## TL;DR

REsCUE is an unsupervised multimodal anomaly detection system that provides real-time feedback on unconscious behavioral cues to assist executive coaching and potentially other applications.

## Contribution

The paper introduces REsCUE, a novel framework that uses unsupervised anomaly detection on multimodal data to identify unconscious behaviors in real-time.

## Key findings

- REsCUE effectively detects behavioral cues in coaching scenarios.
- The system provides intuitive real-time feedback to coaches.
- REsCUE's unsupervised approach requires no prior knowledge.

## Abstract

Executive coaching has been drawing more and more attention for developing corporate managers. While conversing with managers, coach practitioners are also required to understand internal states of coachees through objective observations. In this paper, we present REsCUE, an automated system to aid coach practitioners in detecting unconscious behaviors of their clients. Using an unsupervised anomaly detection algorithm applied to multimodal behavior data such as the subject's posture and gaze, REsCUE notifies behavioral cues for coaches via intuitive and interpretive feedback in real-time. Our evaluation with actual coaching scenes confirms that REsCUE provides the informative cues to understand internal states of coachees. Since REsCUE is based on the unsupervised method and does not assume any prior knowledge, further applications beside executive coaching are conceivable using our framework.