Achieving Hiding and Smart Anti-Jamming Communication: A Parallel DRL Approach against Moving Reactive Jammer

TL;DR

This paper introduces a parallel deep reinforcement learning approach to enhance anti-jamming communication, effectively balancing hiding and evasion against sophisticated moving reactive jammers, with significant throughput improvements.

Contribution

It proposes a novel parallelized DRL framework that decomposes action spaces and accelerates convergence for anti-jamming, addressing complex joint optimization challenges.

Findings

Achieves nearly 90% increase in normalized throughput

Effectively balances hiding and evasion in dynamic jamming scenarios

Demonstrates faster convergence with a parallel exploration mechanism

Abstract

This paper addresses the challenge of anti-jamming in moving reactive jamming scenarios. The moving reactive jammer initiates high-power tracking jamming upon detecting any transmission activity, and when unable to detect a signal, resorts to indiscriminate jamming. This presents dual imperatives: maintaining hiding to avoid the jammer's detection and simultaneously evading indiscriminate jamming. Spread spectrum techniques effectively reduce transmitting power to elude detection but fall short in countering indiscriminate jamming. Conversely, changing communication frequencies can help evade indiscriminate jamming but makes the transmission vulnerable to tracking jamming without spread spectrum techniques to remain hidden. Current methodologies struggle with the complexity of simultaneously optimizing these two requirements due to the expansive joint action spaces and the dynamics of moving reactive jammers. To address these challenges, we propose a parallelized deep reinforcement learning (DRL) strategy. The approach includes a parallelized network architecture designed to decompose the action space. A parallel exploration-exploitation selection mechanism replaces the $\varepsilon $-greedy mechanism, accelerating convergence. Simulations demonstrate a nearly 90\% increase in normalized throughput.