DRLE: Decentralized Reinforcement Learning at the Edge for Traffic Light Control in the IoV

TL;DR

This paper introduces DRLE, a decentralized reinforcement learning approach at the network edge for real-time traffic light control in the Internet of Vehicles, leveraging edge computing and multi-agent coordination to reduce congestion.

Contribution

The paper presents a novel decentralized reinforcement learning framework that operates at the network edge, enabling scalable and real-time traffic light control in the IoV environment.

Findings

DRLE outperforms existing algorithms in reducing traffic congestion.

The decentralized approach achieves near-optimal control with mathematical guarantees.

Real-time adaptation improves traffic flow and network efficiency.

Abstract

The Internet of Vehicles (IoV) enables real-time data exchange among vehicles and roadside units and thus provides a promising solution to alleviate traffic jams in the urban area. Meanwhile, better traffic management via efficient traffic light control can benefit the IoV as well by enabling a better communication environment and decreasing the network load. As such, IoV and efficient traffic light control can formulate a virtuous cycle. Edge computing, an emerging technology to provide low-latency computation capabilities at the edge of the network, can further improve the performance of this cycle. However, while the collected information is valuable, an efficient solution for better utilization and faster feedback has yet to be developed for edge-empowered IoV. To this end, we propose a Decentralized Reinforcement Learning at the Edge for traffic light control in the IoV (DRLE). DRLE exploits the ubiquity of the IoV to accelerate the collection of traffic data and its interpretation towards alleviating congestion and providing better traffic light control. DRLE operates within the coverage of the edge servers and uses aggregated data from neighboring edge servers to provide city-scale traffic light control. DRLE decomposes the highly complex problem of large area control. into a decentralized multi-agent problem. We prove its global optima with concrete mathematical reasoning. The proposed decentralized reinforcement learning algorithm running at each edge node adapts the traffic lights in real time. We conduct extensive evaluations and demonstrate the superiority of this approach over several state-of-the-art algorithms.