Efficient Safety Testing of Autonomous Vehicles via Adaptive Search over Crash-Derived Scenarios

TL;DR

This paper presents an adaptive search algorithm that significantly improves the efficiency of safety testing for autonomous vehicles by focusing on crash-derived scenarios, achieving high coverage of safety-critical situations.

Contribution

It introduces an accelerated testing algorithm, ALVNS-SA, that enhances safety scenario coverage for AVs using crash data and adaptive search techniques.

Findings

Achieves 84% safety-critical scenario coverage

Reaches 96.83% crash scenario coverage

Outperforms genetic and random testing methods

Abstract

Ensuring the safety of autonomous vehicles (AVs) is paramount in their development and deployment. Safety-critical scenarios pose more severe challenges, necessitating efficient testing methods to validate AVs safety. This study focuses on designing an accelerated testing algorithm for AVs in safety-critical scenarios, enabling swift recognition of their driving capabilities. First, typical logical scenarios were extracted from real-world crashes in the China In-depth Mobility Safety Study-Traffic Accident (CIMSS-TA) database, obtaining pre-crash features through reconstruction. Second, Baidu Apollo, an advanced black-box automated driving system (ADS) is integrated to control the behavior of the ego vehicle. Third, we proposed an adaptive large-variable neighborhood-simulated annealing algorithm (ALVNS-SA) to expedite the testing process. Experimental results demonstrate a significant enhancement in testing efficiency when utilizing ALVNS-SA. It achieves an 84.00% coverage of safety-critical scenarios, with crash scenario coverage of 96.83% and near-crash scenario coverage of 92.07%. Compared to genetic algorithm (GA), adaptive large neighborhood-simulated annealing algorithm (ALNS-SA), and random testing, ALVNS-SA exhibits substantially higher coverage in safety-critical scenarios.