A Comprehensive Study of Bug-Fix Patterns in Autonomous Driving Systems

TL;DR

This study analyzes bug-fix patterns in autonomous driving systems, revealing dominant categories and proposing taxonomies to improve debugging and reliability in safety-critical applications.

Contribution

It introduces a comprehensive taxonomy of bug-fix patterns and provides a benchmark dataset for autonomous driving system bugs, advancing understanding of debugging practices.

Findings

Identified key bug-fix patterns in path planning, data flow, and configuration management.

Discovered significant variation in bug-fix pattern frequency based on bug type.

Provided a benchmark dataset of 1,331 bug-fix instances for future research.

Abstract

As autonomous driving systems (ADSes) become increasingly complex and integral to daily life, the importance of understanding the nature and mitigation of software bugs in these systems has grown correspondingly. Addressing the challenges of software maintenance in autonomous driving systems (e.g., handling real-time system decisions and ensuring safety-critical reliability) is crucial due to the unique combination of real-time decision-making requirements and the high stakes of operational failures in ADSes. The potential of automated tools in this domain is promising, yet there remains a gap in our comprehension of the challenges faced and the strategies employed during manual debugging and repair of such systems. In this paper, we present an empirical study that investigates bug-fix patterns in ADSes, with the aim of improving reliability and safety. We have analyzed the commit histories and bug reports of two major autonomous driving projects, Apollo and Autoware, from 1,331 bug fixes with the study of bug symptoms, root causes, and bug-fix patterns. Our study reveals several dominant bug-fix patterns, including those related to path planning, data flow, and configuration management. Additionally, we find that the frequency distribution of bug-fix patterns varies significantly depending on their nature and types and that certain categories of bugs are recurrent and more challenging to exterminate. Based on our findings, we propose a hierarchy of ADS bugs and two taxonomies of 15 syntactic bug-fix patterns and 27 semantic bug-fix patterns that offer guidance for bug identification and resolution. We also contribute a benchmark of 1,331 ADS bug-fix instances.