Real-Time Remote Control via VR over Limited Wireless Connectivity

TL;DR

This paper presents a VR-based remote robot control system that maintains seamless operation by switching to autonomous mode during connectivity issues, utilizing real-time mapping and continuous connectivity monitoring.

Contribution

It introduces an integrated system combining VR control, real-time mapping, and autonomous switching to improve remote human-robot interaction over limited wireless networks.

Findings

Successful implementation of VR remote control with real-time map updates

Automatic switch to autonomous mode during connectivity loss

Enhanced robustness of human-robot interaction in limited connectivity scenarios

Abstract

This work introduces a solution to enhance human-robot interaction over limited wireless connectivity. The goal is toenable remote control of a robot through a virtual reality (VR)interface, ensuring a smooth transition to autonomous mode in the event of connectivity loss. The VR interface provides accessto a dynamic 3D virtual map that undergoes continuous updatesusing real-time sensor data collected and transmitted by therobot. Furthermore, the robot monitors wireless connectivity and automatically switches to a autonomous mode in scenarios with limited connectivity. By integrating four key functionalities: real-time mapping, remote control through glasses VR, continuous monitoring of wireless connectivity, and autonomous navigation during limited connectivity, we achieve seamless end-to-end operation.