A Collaborative Safety Shield for Safe and Efficient CAV Lane Changes in Congested On-Ramp Merging

TL;DR

This paper introduces MARL-MASS, a novel multi-agent reinforcement learning lane change controller with a safety shield that guarantees safety and enhances traffic efficiency in congested CAV merging scenarios.

Contribution

It develops the MASS safety shield using Control Barrier Functions and integrates it with MARL to ensure safe, collaborative lane changes while improving efficiency.

Findings

MASS guarantees safety constraints during lane changes.

The integrated MARL-MASS improves traffic flow stability.

The approach balances safety and efficiency effectively.

Abstract

Lane changing in dense traffic is a significant challenge for Connected and Autonomous Vehicles (CAVs). Existing lane change controllers primarily either ensure safety or collaboratively improve traffic efficiency, but do not consider these conflicting objectives together. To address this, we propose the Multi-Agent Safety Shield (MASS), designed using Control Barrier Functions (CBFs) to enable safe and collaborative lane changes. The MASS enables collaboration by capturing multi-agent interactions among CAVs through interaction topologies constructed as a graph using a simple algorithm. Further, a state-of-the-art Multi-Agent Reinforcement Learning (MARL) lane change controller is extended by integrating MASS to ensure safety and defining a customised reward function to prioritise efficiency improvements. As a result, we propose a lane change controller, known as MARL-MASS, and evaluate it in a congested on-ramp merging simulation. The results demonstrate that MASS enables collaborative lane changes with safety guarantees by strictly respecting the safety constraints. Moreover, the proposed custom reward function improves the stability of MARL policies trained with a safety shield. Overall, by encouraging the exploration of a collaborative lane change policy while respecting safety constraints, MARL-MASS effectively balances the trade-off between ensuring safety and improving traffic efficiency in congested traffic. The code for MARL-MASS is available with an open-source licence at https://github.com/hkbharath/MARL-MASS