FocalAD: Local Motion Planning for End-to-End Autonomous Driving

TL;DR

FocalAD is an end-to-end autonomous driving framework that emphasizes critical local interactions for improved planning and safety, outperforming existing methods on multiple benchmarks.

Contribution

It introduces a novel local interaction module and loss function to enhance local motion representations and decision-making in autonomous driving.

Findings

Outperforms state-of-the-art methods on nuScenes and Bench2Drive datasets.

Reduces collision rate by 41.9% on Adv-nuScenes dataset.

Enhances local motion understanding for safer autonomous driving.

Abstract

In end-to-end autonomous driving,the motion prediction plays a pivotal role in ego-vehicle planning. However, existing methods often rely on globally aggregated motion features, ignoring the fact that planning decisions are primarily influenced by a small number of locally interacting agents. Failing to attend to these critical local interactions can obscure potential risks and undermine planning reliability. In this work, we propose FocalAD, a novel end-to-end autonomous driving framework that focuses on critical local neighbors and refines planning by enhancing local motion representations. Specifically, FocalAD comprises two core modules: the Ego-Local-Agents Interactor (ELAI) and the Focal-Local-Agents Loss (FLA Loss). ELAI conducts a graph-based ego-centric interaction representation that captures motion dynamics with local neighbors to enhance both ego planning and agent motion queries. FLA Loss increases the weights of decision-critical neighboring agents, guiding the model to prioritize those more relevant to planning. Extensive experiments show that FocalAD outperforms existing state-of-the-art methods on the open-loop nuScenes datasets and closed-loop Bench2Drive benchmark. Notably, on the robustness-focused Adv-nuScenes dataset, FocalAD achieves even greater improvements, reducing the average colilision rate by 41.9% compared to DiffusionDrive and by 15.6% compared to SparseDrive.