World Models for Autonomous Driving: An Initial Survey

TL;DR

This survey reviews the current state and future prospects of world models in autonomous driving, emphasizing their role in predicting scenarios and enhancing decision-making for safer, more efficient autonomous vehicles.

Contribution

It provides an initial comprehensive overview of world models in autonomous driving, covering theoretical foundations, practical applications, and research challenges.

Findings

World models improve prediction accuracy in autonomous driving.

They help in decision-making and handling sensor data gaps.

Research is ongoing to overcome current limitations.

Abstract

In the rapidly evolving landscape of autonomous driving, the capability to accurately predict future events and assess their implications is paramount for both safety and efficiency, critically aiding the decision-making process. World models have emerged as a transformative approach, enabling autonomous driving systems to synthesize and interpret vast amounts of sensor data, thereby predicting potential future scenarios and compensating for information gaps. This paper provides an initial review of the current state and prospective advancements of world models in autonomous driving, spanning their theoretical underpinnings, practical applications, and the ongoing research efforts aimed at overcoming existing limitations. Highlighting the significant role of world models in advancing autonomous driving technologies, this survey aspires to serve as a foundational reference for the research community, facilitating swift access to and comprehension of this burgeoning field, and inspiring continued innovation and exploration.