A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

TL;DR

This paper introduces a novel human-robot collaboration framework combining AR and haptic interfaces, balancing safety and efficiency through a decoupled control system that adapts to unforeseen changes and learns from demonstrations.

Contribution

It proposes a complementary framework utilizing vision-based control, null space collaboration, and mixed AR-haptic interfaces, enabling adaptive, safe, and efficient human-robot collaboration.

Findings

Effective decoupling of task and null space control

Successful learning of demonstrations with DMP

Stable closed-loop system verified by Lyapunov methods

Abstract

There is invariably a trade-off between safety and efficiency for collaborative robots (cobots) in human-robot collaborations. Robots that interact minimally with humans can work with high speed and accuracy but cannot adapt to new tasks or respond to unforeseen changes, whereas robots that work closely with humans can but only by becoming passive to humans, meaning that their main tasks suspended and efficiency compromised. Accordingly, this paper proposes a new complementary framework for human-robot collaboration that balances the safety of humans and the efficiency of robots. In this framework, the robot carries out given tasks using a vision-based adaptive controller, and the human expert collaborates with the robot in the null space. Such a decoupling drives the robot to deal with existing issues in task space (e.g., uncalibrated camera, limited field of view) and in null space (e.g., joint limits) by itself while allowing the expert to adjust the configuration of the robot body to respond to unforeseen changes (e.g., sudden invasion, change of environment) without affecting the robot's main task. Additionally, the robot can simultaneously learn the expert's demonstration in task space and null space beforehand with dynamic movement primitives (DMP). Therefore, an expert's knowledge and a robot's capability are both explored and complementary. Human demonstration and involvement are enabled via a mixed interaction interface, i.e., augmented reality (AR) and haptic devices. The stability of the closed-loop system is rigorously proved with Lyapunov methods. Experimental results in various scenarios are presented to illustrate the performance of the proposed method.