Learning to Communicate Functional States with Nonverbal Expressions for Improved Human-Robot Collaboration

TL;DR

This paper presents a reinforcement learning approach that modulates nonverbal auditory cues to improve human understanding of robot states, enhancing collaboration and reducing communication errors.

Contribution

It introduces a novel RL-based method to optimize nonverbal auditory expressions for conveying robot states, incorporating human feedback for better interpretability.

Findings

RL approach effectively improves state recognition accuracy

Using prior user data accelerates learning process

Pitch bend modulation significantly influences user perception

Abstract

Collaborative robots must effectively communicate their internal state to humans to enable a smooth interaction. Nonverbal communication is widely used to communicate information during human-robot interaction, however, such methods may also be misunderstood, leading to communication errors. In this work, we explore modulating the acoustic parameter values (pitch bend, beats per minute, beats per loop) of nonverbal auditory expressions to convey functional robot states (accomplished, progressing, stuck). We propose a reinforcement learning (RL) algorithm based on noisy human feedback to produce accurately interpreted nonverbal auditory expressions. The proposed approach was evaluated through a user study with 24 participants. The results demonstrate that: 1. Our proposed RL-based approach is able to learn suitable acoustic parameter values which improve the users' ability to correctly identify the state of the robot. 2. Algorithm initialization informed by previous user data can be used to significantly speed up the learning process. 3. The method used for algorithm initialization strongly influences whether participants converge to similar sounds for each robot state. 4. Modulation of pitch bend has the largest influence on user association between sounds and robotic states.