Teleoperated Omni-directional Dual Arm Mobile Manipulation Robotic System with Shared Control for Retail Store

TL;DR

This paper presents a teleoperated omni-directional dual-arm mobile robot with shared VR-based control and heterogeneous grippers, designed for flexible manipulation in retail environments, validated through mockup tests.

Contribution

It introduces a novel teleoperation system with shared VR control and heterogeneous grippers for retail robots, enhancing adaptability and manipulation capabilities.

Findings

Effective manipulation of retail items demonstrated

Shared VR control enables intuitive teleoperation

Dual-arm coordination improves handling versatility

Abstract

The swiftly expanding retail sector is increasingly adopting autonomous mobile robots empowered by artificial intelligence and machine learning algorithms to gain an edge in the competitive market. However, these autonomous robots encounter challenges in adapting to the dynamic nature of retail products, often struggling to operate autonomously in novel situations. In this study, we introduce an omni-directional dual-arm mobile robot specifically tailored for use in retail environments. Additionally, we propose a tele-operation method that enables shared control between the robot and a human operator. This approach utilizes a Virtual Reality (VR) motion capture system to capture the operator's commands, which are then transmitted to the robot located remotely in a retail setting. Furthermore, the robot is equipped with heterogeneous grippers on both manipulators, facilitating the handling of a wide range of items. We validate the efficacy of the proposed system through testing in a mockup of retail environment, demonstrating its ability to manipulate various commonly encountered retail items using both single and dual-arm coordinated manipulation techniques.