DeepMF: Deep Motion Factorization for Closed-Loop Safety-Critical Driving Scenario Simulation

TL;DR

DeepMF introduces a novel deep neural network-based framework for simulating safety-critical traffic scenarios in autonomous driving, enabling open-ended, interactive, and risk-focused scenario generation beyond recorded data.

Contribution

It extends static safety scenario generation to a closed-loop, interactive framework using Bayesian factorization and neural networks for more realistic and diverse traffic simulation.

Findings

Outperforms existing methods in risk management and diversity

Efficiently simulates a wide range of high-risk scenarios

Demonstrates robustness and flexibility in traffic simulation

Abstract

Safety-critical traffic scenarios are of great practical relevance to evaluating the robustness of autonomous driving (AD) systems. Given that these long-tail events are extremely rare in real-world traffic data, there is a growing body of work dedicated to the automatic traffic scenario generation. However, nearly all existing algorithms for generating safety-critical scenarios rely on snippets of previously recorded traffic events, transforming normal traffic flow into accident-prone situations directly. In other words, safety-critical traffic scenario generation is hindsight and not applicable to newly encountered and open-ended traffic events.In this paper, we propose the Deep Motion Factorization (DeepMF) framework, which extends static safety-critical driving scenario generation to closed-loop and interactive adversarial traffic simulation. DeepMF casts safety-critical traffic simulation as a Bayesian factorization that includes the assignment of hazardous traffic participants, the motion prediction of selected opponents, the reaction estimation of autonomous vehicle (AV) and the probability estimation of the accident occur. All the aforementioned terms are calculated using decoupled deep neural networks, with inputs limited to the current observation and historical states. Consequently, DeepMF can effectively and efficiently simulate safety-critical traffic scenarios at any triggered time and for any duration by maximizing the compounded posterior probability of traffic risk. Extensive experiments demonstrate that DeepMF excels in terms of risk management, flexibility, and diversity, showcasing outstanding performance in simulating a wide range of realistic, high-risk traffic scenarios.