Towards Intuitive HMI for UAV Control

TL;DR

This paper compares traditional joystick control with a novel human pose-based control method for UAVs, demonstrating potential for more intuitive operation especially for new users through simulation experiments.

Contribution

It introduces a human pose control modality for UAVs and evaluates its effectiveness against joystick control in terms of user experience and performance.

Findings

Human pose control is comparable to joystick in maze navigation tasks.

Participants reported lower workload with pose control.

The approach enhances intuitiveness for UAV operation.

Abstract

In the last decade, UAVs have become a widely used technology. As they are used by both professionals and amateurs, there is a need to explore different control modalities to make control intuitive and easier, especially for new users. In this work, we compared the most widely used joystick control with a custom human pose control. We used human pose estimation and arm movements to send UAV commands in the same way that operators use their fingers to send joystick commands. Experiments were conducted in a simulation environment with first-person visual feedback. Participants had to traverse the same maze with joystick and human pose control. Participants' subjective experience was assessed using the raw NASA Task Load Index.