Empowering Microscopic Traffic Simulators with Realistic Perception using Surrogate Sensor Models

TL;DR

This paper introduces MIDAR, a surrogate LiDAR detection model that enhances microscopic traffic simulators with realistic perception capabilities, enabling scalable and high-fidelity traffic system evaluations.

Contribution

MIDAR provides a novel, geometry-aware surrogate perception model that accurately mimics LiDAR detections using high-level features, bridging the gap between scalable traffic simulators and realistic perception modeling.

Findings

MIDAR achieves high AUC scores of 0.94 with CARLA data and 0.86 with nuScenes data.

Integrating MIDAR improves perception realism and application performance in traffic simulations.

MIDAR introduces minimal computational overhead, enabling real-time large-scale simulations.

Abstract

Simulation is central to the evaluation of intelligent transportation system (ITS) applications. As ITS increasingly incorporates autonomous vehicle (AV) technologies as fleet vehicles and/or mobile sensors, accurate modeling of their perception capabilities becomes essential in high-fidelity simulations. While game-engine-based simulators reproduce realistic perception environments through 3D scene rendering and raw sensor data generation, they face scalability challenges in simulating traffic networks with a large number of AVs due to high computational cost. In contrast, microscopic traffic simulators (MTS) can scale efficiently but lack perception modeling capabilities. To bridge this gap, we propose MIDAR, a surrogate LiDAR detection model that mimics realistic LiDAR detections using only high-level features readily available from MTS. Specifically, MIDAR predicts true-positive and false-negative LiDAR detections based on the relative positions and dimensions of surrounding objects. To capture LiDAR visibility and occlusion effects, MIDAR introduces a ray-hit feature and a Refined Multi-hop Line-of-Sight (RM-LoS) graph processed by a geometry-aware Graph Transformer. MIDAR achieves an AUC of 0.94 in approximating LiDAR detection results using CARLA-generated point cloud data, and an AUC of 0.86 with real-world data from the nuScenes dataset. Two ITS applications, cooperative-perception-based adaptive signal control and vehicle trajectory reconstruction, are integrated with MIDAR to further validate its realism and necessity. Results show that MIDAR generates more realistic detection outputs as well as application-level performance metrics than simplified perception models while introducing minimal computational overhead, enabling seamless integration into large-scale, real-time traffic simulations. The code and data are publicly available at https://github.com/Purdue-CART-Lab/MIDAR.