Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien and, James Tompkin, George Konidaris, Stefanie Tellex

TL;DR
This paper introduces a mixed reality head-mounted display system for communicating robot arm motion intent, significantly improving accuracy and speed over traditional 2D displays in collaborative environments.
Contribution
It presents a novel mixed reality visualization method for robot motion intent, outperforming 2D displays and no visualization in accuracy and response time.
Findings
16% increase in accuracy
62% decrease in task completion time
More effective communication of robot motion intent
Abstract
Efficient motion intent communication is necessary for safe and collaborative work environments with collocated humans and robots. Humans efficiently communicate their motion intent to other humans through gestures, gaze, and social cues. However, robots often have difficulty efficiently communicating their motion intent to humans via these methods. Many existing methods for robot motion intent communication rely on 2D displays, which require the human to continually pause their work and check a visualization. We propose a mixed reality head-mounted display visualization of the proposed robot motion over the wearer's real-world view of the robot and its environment. To evaluate the effectiveness of this system against a 2D display visualization and against no visualization, we asked 32 participants to labeled different robot arm motions as either colliding or non-colliding with blocks…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
