Two-Timescale Optimization Framework for IAB-Enabled Heterogeneous UAV Networks

TL;DR

This paper introduces a two-timescale optimization framework using deep reinforcement learning for heterogeneous UAV networks, enhancing communication throughput in post-disaster scenarios with integrated tethered and untethered UAVs.

Contribution

It proposes a novel two-timescale joint user scheduling and trajectory control method using a multi-agent deep reinforcement learning algorithm for UAV networks.

Findings

The proposed TTS-MADDPG algorithm outperforms benchmarks in throughput.

Up to 12.2% average throughput gain over existing methods.

Robust performance under asymmetric traffic and mobility conditions.

Abstract

In post-disaster scenarios, the rapid deployment of adequate communication infrastructure is essential to support disaster search, rescue, and recovery operations. To achieve this, uncrewed aerial vehicle (UAV) has emerged as a promising solution for emergency communication due to its low cost and deployment flexibility. However, conventional untethered UAV (U-UAV) is constrained by size, weight, and power (SWaP) limitations, making it incapable of maintaining the operation of a macro base station. To address this limitation, we propose a heterogeneous UAV-based framework that integrates tethered UAV (T-UAV) and U-UAVs, where U-UAVs are utilized to enhance the throughput of cell-edge ground user equipments (G-UEs) and guarantee seamless connectivity during G-UEs' mobility to safe zones. It is noted that the integrated access and backhaul (IAB) technique is adopted to support the wireless backhaul of U-UAVs. Accordingly, we formulate a two-timescale joint user scheduling and trajectory control optimization problem, aiming to maximize the downlink throughput under asymmetric traffic demands and G-UEs' mobility. To solve the formulated problem, we proposed a two-timescale multi-agent deep deterministic policy gradient (TTS-MADDPG) algorithm based on the centralized training and distributed execution paradigm. Numerical results show that the proposed algorithm outperforms other benchmarks, including the two-timescale multi-agent proximal policy optimization (TTS-MAPPO) algorithm and MADDPG scheduling method, with robust and higher throughput. Specifically, the proposed algorithm obtains up to 12.2\% average throughput gain compared to the MADDPG scheduling method.