Gesture-based Piloting of an Aerial Robot using Monocular Vision

TL;DR

This paper presents an economical monocular vision system enabling gesture-based control of aerial robots, addressing practical issues like hardware cost, gesture design, and algorithm simplicity, and demonstrating successful implementation.

Contribution

It introduces a cost-effective monocular system for gesture-based aerial robot piloting, considering practical hardware, gesture design principles, and algorithm applicability.

Findings

System successfully implemented on an aerial robot

Effective natural arm gesture mapping achieved

Practical scenarios and hardware costs evaluated

Abstract

Aerial robots are becoming popular among general public, and with the development of artificial intelligence (AI), there is a trend to equip aerial robots with a natural user interface (NUI). Hand/arm gestures are an intuitive way to communicate for humans, and various research works have focused on controlling an aerial robot with natural gestures. However, the techniques in this area are still far from mature. Many issues in this area have been poorly addressed, such as the principles of choosing gestures from the design point of view, hardware requirements from an economic point of view, considerations of data availability, and algorithm complexity from a practical perspective. Our work focuses on building an economical monocular system particularly designed for gesture-based piloting of an aerial robot. Natural arm gestures are mapped to rich target directions and convenient fine adjustment is achieved. Practical piloting scenarios, hardware cost and algorithm applicability are jointly considered in our system design. The entire system is successfully implemented in an aerial robot and various properties of the system are tested.