Mixed Reality Teleoperation Assistance for Direct Control of Humanoids

TL;DR

This paper presents a mixed reality and assistive autonomy framework that significantly improves the efficiency and accuracy of humanoid robot teleoperation, integrating user control with autonomous functions for better task performance.

Contribution

It introduces a novel mixed reality-assisted teleoperation method combining probabilistic movement primitives and affordance templates for humanoid robots.

Findings

Enhanced task efficiency demonstrated in experiments

Maintained human-like motion during autonomous assistance

Feasibility confirmed on Nadia robot

Abstract

Teleoperation plays a crucial role in enabling robot operations in challenging environments, yet existing limitations in effectiveness and accuracy necessitate the development of innovative strategies for improving teleoperated tasks. This article introduces a novel approach that utilizes mixed reality and assistive autonomy to enhance the efficiency and precision of humanoid robot teleoperation. By leveraging Probabilistic Movement Primitives, object detection, and Affordance Templates, the assistance combines user motion with autonomous capabilities, achieving task efficiency while maintaining human-like robot motion. Experiments and feasibility studies on the Nadia robot confirm the effectiveness of the proposed framework.