The Power of Combined Modalities in Interactive Robot Learning

TL;DR

This paper investigates how combining multiple input modalities, including novel meta-modalities, enhances robot learning performance and user experience during human-robot interaction.

Contribution

It introduces the concept of meta-modalities and evaluates their combined effect on robot learning, demonstrating improved outcomes over individual modalities.

Findings

Combined modalities significantly improve robot learning behavior.

Users prefer multimodal feedback for better usability.

Meta-modalities enhance interactive freedom in robot learning.

Abstract

This study contributes to the evolving field of robot learning in interaction with humans, examining the impact of diverse input modalities on learning outcomes. It introduces the concept of "meta-modalities" which encapsulate additional forms of feedback beyond the traditional preference and scalar feedback mechanisms. Unlike prior research that focused on individual meta-modalities, this work evaluates their combined effect on learning outcomes. Through a study with human participants, we explore user preferences for these modalities and their impact on robot learning performance. Our findings reveal that while individual modalities are perceived differently, their combination significantly improves learning behavior and usability. This research not only provides valuable insights into the optimization of human-robot interactive task learning but also opens new avenues for enhancing the interactive freedom and scaffolding capabilities provided to users in such settings.