Is Scenario Generation Ready for SOTIF? A Systematic Literature Review

TL;DR

This paper reviews existing scenario generation techniques for testing automated driving systems, revealing they do not yet fully meet the requirements of the SOTIF standard and suggesting future research directions.

Contribution

It systematically classifies and evaluates current scenario generation methods in relation to SOTIF requirements, highlighting gaps and proposing future research directions.

Findings

Existing techniques do not fully comply with SOTIF requirements

Scenarios vary in real-world detail coverage

Many scenarios are system-specific or generic without minimizing hazards

Abstract

Scenario-based testing is considered state-of-the-art to verify and validate Advanced Driver Assistance Systems or Automated Driving Systems. Due to the official launch of the SOTIF-standard (ISO 21448), scenario-based testing becomes more and more relevant for releasing those Highly Automated Driving Systems. However, an essential missing detail prevent the practical application of the SOTIF-standard: How to practically generate scenarios for scenario-based testing? In this paper, we perform a Systematic Literature Review to identify techniques that generate scenarios complying with requirements of the SOTIF-standard. We classify existing scenario generation techniques and evaluate the characteristics of generated scenarios wrt. SOTIF requirements. We investigate which details of the real-world are covered by generated scenarios, whether scenarios are specific for a system under test or generic, and whether scenarios are designed to minimize the set of unknown and hazardous scenarios. We conclude that scenarios generated with existing techniques do not comply with requirements implied by the SOTIF-standard; hence, we propose directions for future research.