Scenario-Based Field Testing of Drone Missions

TL;DR

This paper introduces FiTS, a scenario-based approach for adaptive field testing of drone missions, aiming to improve guidance, data collection, and quality assurance in volatile environments.

Contribution

It presents the FiTS approach, integrating scenario-based requirements engineering and Behavior-Driven Development for structured drone field testing guidance.

Findings

FiTS is feasible in real drone rescue scenarios.

FiTS is useful for facilitating drone field testing.

Interviews confirm FiTS's usefulness and suggest further improvements.

Abstract

Testing and validating Cyber-Physical Systems (CPSs) in the aerospace domain, such as field testing of drone rescue missions, poses challenges due to volatile mission environments, such as weather conditions. While testing processes and methodologies are well established, structured guidance and execution support for field tests are still weak. This paper identifies requirements for field testing of drone missions, and introduces the Field Testing Scenario Management (FiTS) approach for adaptive field testing guidance. FiTS aims to provide sufficient guidance for field testers as a foundation for efficient data collection to facilitate quality assurance and iterative improvement of field tests and CPSs. FiTS shall leverage concepts from scenario-based requirements engineering and Behavior-Driven Development to define structured and reusable test scenarios, with dedicated tasks and responsibilities for role-specific guidance. We evaluate FiTS by (i) applying it to three use cases for a search-and-rescue drone application to demonstrate feasibility and (ii) interviews with experienced drone developers to assess its usefulness and collect further requirements. The study results indicate FiTS to be feasible and useful to facilitate drone field testing and data analysis