An Interactive Indoor Drone Assistant
Tino Fuhrman, David Schneider, Felix Altenberg, Tung Nguyen, Simon, Blasen, Stefan Constantin, Alex Waibel

TL;DR
This paper presents an indoor drone assistant capable of understanding human instructions and performing tasks in a complex environment, demonstrating a 78% success rate in real laboratory missions.
Contribution
It introduces an integrated system combining dialogue, navigation, and perception components for interactive indoor drone assistance, highlighting its performance and limitations.
Findings
78% mission success rate over 27 missions
Effective integration of dialogue and navigation components
Analysis of system performance and limitations
Abstract
With the rapid advance of sophisticated control algorithms, the capabilities of drones to stabilise, fly and manoeuvre autonomously have dramatically improved, enabling us to pay greater attention to entire missions and the interaction of a drone with humans and with its environment during the course of such a mission. In this paper, we present an indoor office drone assistant that is tasked to run errands and carry out simple tasks at our laboratory, while given instructions from and interacting with humans in the space. To accomplish its mission, the system has to be able to understand verbal instructions from humans, and perform subject to constraints from control and hardware limitations, uncertain localisation information, unpredictable and uncertain obstacles and environmental factors. We combine and evaluate the dialogue, navigation, flight control, depth perception and collision…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
