StyleDrive: Towards Driving-Style Aware Benchmarking of End-To-End Autonomous Driving

TL;DR

This paper introduces a large-scale real-world dataset and benchmark for personalized end-to-end autonomous driving, emphasizing the importance of driving style customization for improved safety and user trust.

Contribution

It presents the first dataset and benchmark specifically designed for evaluating personalized end-to-end autonomous driving models, incorporating rich scene and dynamic context.

Findings

Personalized driving preferences improve behavioral alignment with human demonstrations.

The dataset enables systematic evaluation of personalization in autonomous driving.

Benchmark facilitates standardized comparison of different personalized E2EAD models.

Abstract

Personalization, while extensively studied in conventional autonomous driving pipelines, has been largely overlooked in the context of end-to-end autonomous driving (E2EAD), despite its critical role in fostering user trust, safety perception, and real-world adoption. A primary bottleneck is the absence of large-scale real-world datasets that systematically capture driving preferences, severely limiting the development and evaluation of personalized E2EAD models. In this work, we introduce the first large-scale real-world dataset explicitly curated for personalized E2EAD, integrating comprehensive scene topology with rich dynamic context derived from agent dynamics and semantics inferred via a fine-tuned vision-language model (VLM). We propose a hybrid annotation pipeline that combines behavioral analysis, rule-and-distribution-based heuristics, and subjective semantic modeling guided by VLM reasoning, with final refinement through human-in-the-loop verification. Building upon this dataset, we introduce the first standardized benchmark for systematically evaluating personalized E2EAD models. Empirical evaluations on state-of-the-art architectures demonstrate that incorporating personalized driving preferences significantly improves behavioral alignment with human demonstrations.