HAIR: Head-mounted AR Intention Recognition

TL;DR

This paper introduces HAIR, a portable head-mounted AR system for intention recognition in human-robot collaboration, reducing reliance on bulky sensors and enabling more intuitive interactions.

Contribution

The paper presents a novel intention recognition system using only a head-mounted display, improving practicality and scalability in real-world scenarios.

Findings

High accuracy in human goal estimation

Effective visualization of robot intentions

Successful basic interactions with industrial robots

Abstract

Human teams exhibit both implicit and explicit intention sharing. To further development of human-robot collaboration, intention recognition is crucial on both sides. Present approaches rely on a vast sensor suite on and around the robot to achieve intention recognition. This relegates intuitive human-robot collaboration purely to such bulky systems, which are inadequate for large-scale, real-world scenarios due to their complexity and cost. In this paper we propose an intention recognition system that is based purely on a portable head-mounted display. In addition robot intention visualisation is also supported. We present experiments to show the quality of our human goal estimation component and some basic interactions with an industrial robot. HAIR should raise the quality of interaction between robots and humans, instead of such interactions raising the hair on the necks of the human coworkers.