Beyond Visual Line of Sight: UAVs with Edge AI, Connected LLMs, and VR for Autonomous Aerial Intelligence

TL;DR

This paper presents a cost-effective UAV platform integrating 5G, edge AI, LLMs, and VR to enable real-time aerial intelligence for applications like emergency response and environmental monitoring.

Contribution

It introduces a novel UAV system combining 5G, edge processing, LLMs, and VR, demonstrating enhanced autonomous aerial intelligence capabilities.

Findings

Low-latency visual stream processing confirmed

Robust 5G connectivity maintained during operations

LLMs improved data analysis and decision support

Abstract

Unmanned Aerial Vehicles are reshaping Non-Terrestrial Networks by acting as agile, intelligent nodes capable of advanced analytics and instantaneous situational awareness. This article introduces a budget-friendly quadcopter platform that unites 5G communications, edge-based processing, and AI to tackle core challenges in NTN scenarios. Outfitted with a panoramic camera, robust onboard computation, and LLMs, the drone system delivers seamless object recognition, contextual analysis, and immersive operator experiences through virtual reality VR technology. Field evaluations confirm the platform's ability to process visual streams with low latency and sustain robust 5G links. Adding LLMs further streamlines operations by extracting actionable insights and refining collected data for decision support. Demonstrated use cases, including emergency response, infrastructure assessment, and environmental surveillance, underscore the system's adaptability in demanding contexts.