Leveraging Augmented Reality for Improved Situational Awareness During UAV-Driven Search and Rescue Missions

TL;DR

This paper introduces VizCom-AR, an augmented reality system that improves communication and spatial awareness for UAV-based search and rescue missions, addressing limitations of traditional radio communication.

Contribution

The paper presents VizCom-AR, a novel AR system that enhances situational awareness and communication between responders in UAV-driven rescue operations.

Findings

VizCom-AR improves spatial awareness for responders.

The system facilitates effective geolocation information exchange.

Field studies show VizCom-AR complements existing communication tools.

Abstract

In the high-stakes domain of search-and-rescue missions, the deployment of Unmanned Aerial Vehicles (UAVs) has become increasingly pivotal. These missions require seamless, real-time communication among diverse roles within response teams, particularly between Remote Operators (ROs) and On-Site Operators (OSOs). Traditionally, ROs and OSOs have relied on radio communication to exchange critical information, such as the geolocation of victims, hazardous areas, and points of interest. However, radio communication lacks information visualization, suffers from noise, and requires mental effort to interpret information, leading to miscommunications and misunderstandings. To address these challenges, this paper presents VizCom-AR, an Augmented Reality system designed to facilitate visual communication between ROs and OSOs and their situational awareness during UAV-driven search-and-rescue missions. Our experiments, focus group sessions with police officers, and field study showed that VizCom-AR enhances spatial awareness of both ROs and OSOs, facilitate geolocation information exchange, and effectively complement existing communication tools in UAV-driven emergency response missions. Overall, VizCom-AR offers a fundamental framework for designing Augmented Reality systems for large scale UAV-driven rescue missions.