Towards Massive Interaction with Generalist Robotics: A Systematic Review of XR-enabled Remote Human-Robot Interaction Systems

TL;DR

This systematic review explores how XR technologies like AR, VR, and MR are used to enhance remote human-robot interaction, highlighting current trends, challenges, and future research opportunities.

Contribution

It provides a comprehensive categorization and analysis of XR-enabled remote HRI systems, identifying gaps and guiding future research directions.

Findings

XR improves intuitive remote control of robots

User experience is significantly enhanced with XR interfaces

Identifies key gaps and future opportunities in XR for HRI

Abstract

The rising interest of generalist robots seek to create robots with versatility to handle multiple tasks in a variety of environments, and human will interact with such robots through immersive interfaces. In the context of human-robot interaction (HRI), this survey provides an exhaustive review of the applications of extended reality (XR) technologies in the field of remote HRI. We developed a systematic search strategy based on the PRISMA methodology. From the initial 2,561 articles selected, 100 research papers that met our inclusion criteria were included. We categorized and summarized the domain in detail, delving into XR technologies, including augmented reality (AR), virtual reality (VR), and mixed reality (MR), and their applications in facilitating intuitive and effective remote control and interaction with robotic systems. The survey highlights existing articles on the application of XR technologies, user experience enhancement, and various interaction designs for XR in remote HRI, providing insights into current trends and future directions. We also identified potential gaps and opportunities for future research to improve remote HRI systems through XR technology to guide and inform future XR and robotics research.