Optimization of End-to-End AoI in Edge-Enabled Vehicular Fog Systems: A Dueling-DQN Approach

TL;DR

This paper introduces a dueling-DQN based method to optimize the end-to-end Age of Information in vehicular fog systems, significantly enhancing real-time data freshness and system decision-making.

Contribution

It presents a novel deep reinforcement learning approach that considers full transmission delays, outperforming existing methods in optimizing information freshness in IoT systems.

Findings

Dueling-DQN outperforms DQN and analytical methods in AoI reduction.

The approach improves decision-making accuracy in vehicular fog systems.

Simulation results confirm enhanced system efficiency and data freshness.

Abstract

In real-time status update services for the Internet of Things (IoT), the timely dissemination of information requiring timely updates is crucial to maintaining its relevance. Failing to keep up with these updates results in outdated information. The age of information (AoI) serves as a metric to quantify the freshness of information. The Existing works to optimize AoI primarily focus on the transmission time from the information source to the monitor, neglecting the transmission time from the monitor to the destination. This oversight significantly impacts information freshness and subsequently affects decision-making accuracy. To address this gap, we designed an edge-enabled vehicular fog system to lighten the computational burden on IoT devices. We examined how information transmission and request-response times influence end-to-end AoI. As a solution, we proposed Dueling-Deep Queue Network (dueling-DQN), a deep reinforcement learning (DRL)-based algorithm and compared its performance with DQN policy and analytical results. Our simulation results demonstrate that the proposed dueling-DQN algorithm outperforms both DQN and analytical methods, highlighting its effectiveness in improving real-time system information freshness. Considering the complete end-to-end transmission process, our optimization approach can improve decision-making performance and overall system efficiency.