R-CARLA: High-Fidelity Sensor Simulations with Interchangeable Dynamics for Autonomous Racing

TL;DR

R-CARLA enhances the CARLA simulator by integrating accurate vehicle dynamics and sensor simulations, enabling more realistic autonomous racing testing and reducing the Sim-to-Real gap significantly.

Contribution

It introduces R-CARLA, a comprehensive simulation platform combining vehicle dynamics, sensor fidelity, and digital twin capabilities for autonomous racing.

Findings

42% reduction in Sim-to-Real gap for car dynamics

82% reduction in sensor simulation gap

Supports full-stack autonomous racing testing

Abstract

Autonomous racing has emerged as a crucial testbed for autonomous driving algorithms, necessitating a simulation environment for both vehicle dynamics and sensor behavior. Striking the right balance between vehicle dynamics and sensor accuracy is crucial for pushing vehicles to their performance limits. However, autonomous racing developers often face a trade-off between accurate vehicle dynamics and high-fidelity sensor simulations. This paper introduces R-CARLA, an enhancement of the CARLA simulator that supports holistic full-stack testing, from perception to control, using a single system. By seamlessly integrating accurate vehicle dynamics with sensor simulations, opponents simulation as NPCs, and a pipeline for creating digital twins from real-world robotic data, R-CARLA empowers researchers to push the boundaries of autonomous racing development. Furthermore, it is developed using CARLA's rich suite of sensor simulations. Our results indicate that incorporating the proposed digital-twin framework into R-CARLA enables more realistic full-stack testing, demonstrating a significant reduction in the Sim-to-Real gap of car dynamics simulation by 42% and by 82% in the case of sensor simulation across various testing scenarios.