DRL-Based Maximization of the Sum Cross-Layer Achievable Rate for Networks Under Jamming

TL;DR

This paper presents a deep reinforcement learning approach using ResNet-based DQN to enable an intelligent user equipment to optimize channel access and maximize the sum cross-layer achievable rate in jamming-affected quasi-static wireless networks.

Contribution

It introduces a novel DRL-based mechanism for channel access that adapts to dynamic conditions and jamming, improving network performance in quasi-static wireless environments.

Findings

The DRL approach effectively maximizes network throughput under jamming.

The intelligent UE learns to avoid collisions and jamming through optimized scheduling.

Simulation results demonstrate significant performance improvements.

Abstract

In quasi-static wireless networks characterized by infrequent changes in the transmission schedules of user equipment (UE), malicious jammers can easily deteriorate network performance. Accordingly, a key challenge in these networks is managing channel access amidst jammers and under dynamic channel conditions. In this context, we propose a robust learning-based mechanism for channel access in multi-cell quasi-static networks under jamming. The network comprises multiple legitimate UEs, including predefined UEs (pUEs) with stochastic predefined schedules and an intelligent UE (iUE) with an undefined transmission schedule, all transmitting over a shared, time-varying uplink channel. Jammers transmit unwanted packets to disturb the pUEs' and the iUE's communication. The iUE's learning process is based on the deep reinforcement learning (DRL) framework, utilizing a residual network (ResNet)-based deep Q-Network (DQN). To coexist in the network and maximize the network's sum cross-layer achievable rate (SCLAR), the iUE must learn the unknown network dynamics while concurrently adapting to dynamic channel conditions. Our simulation results reveal that, with properly defined state space, action space, and rewards in DRL, the iUE can effectively coexist in the network, maximizing channel utilization and the network's SCLAR by judiciously selecting transmission time slots and thus avoiding collisions and jamming.