Plate-forme Magicien d'Oz pour l'\'etude de l'apport des ACAs \`a l'interaction

TL;DR

This paper presents a versatile software platform based on the Wizard of Oz paradigm to evaluate the impact of Embodied Conversational Agents on human-computer interaction, usability, and user satisfaction.

Contribution

It introduces a novel platform capable of simulating and analyzing interactions with ACAs across various Windows applications, including multimodal data collection and replay.

Findings

Users' subjective judgments on multimodal help systems were assessed.

The platform successfully collected detailed interaction data, including speech and eye fixations.

The embodied 3D talking head improved user engagement in software assistance.

Abstract

In order to evaluate the contribution of Embodied (Animated) Conversational Agents (ECAs) to the effectiveness and usability of human-computer interaction, we developed a software platform meant to collect usage data. This platform, which implements the wizard of Oz paradigm, makes it possible to simulate user interfaces integrating ACAs for any Windows software application. It can also save and "replay" a rich interaction trace including user and system events, screen captures, users' speech and eye fixations. This platform has been used to assess users' subjective judgements and reactions to a multimodal online help system meant to facilitate the use of software for the general public (Flash). The online help system is embodied using a 3D talking head (developed by FT R&D) which "says" oral help messages illustrated with Flash screen copies.