AdaptSky: A DRL Based Resource Allocation Framework in NOMA-UAV Networks

TL;DR

AdaptSky introduces a novel DRL-based framework that optimizes 3D-UAV placement and NOMA resource allocation across sub-6GHz and mmWave spectra, enhancing data rates and fairness in UAV networks.

Contribution

It is the first to jointly optimize NOMA power allocation with 3D-UAV placement using DRL and integrates the dueling network architecture for improved learning.

Findings

Outperforms state-of-the-art in data rate and fairness

Exhibits fast adaptation and strong generalization

Works across sub-6GHz and mmWave spectra

Abstract

Unmanned aerial vehicle (UAV) has recently attracted a lot of attention as a candidate to meet the 6G ubiquitous connectivity demand and boost the resiliency of terrestrial networks. Thanks to the high spectral efficiency and low latency, non-orthogonal multiple access (NOMA) is a potential access technique for future communication networks. In this paper, we propose to use the UAV as a moving base station (BS) to serve multiple users using NOMA and jointly solve for the 3D-UAV placement and resource allocation problem. Since the corresponding optimization problem is non-convex, we rely on the recent advances in artificial intelligence (AI) and propose AdaptSky, a deep reinforcement learning (DRL)-based framework, to efficiently solve it. To the best of our knowledge, AdaptSky is the first framework that optimizes NOMA power allocation jointly with 3D-UAV placement using both sub-6GHz and millimeter wave mmWave spectrum. Furthermore, for the first time in NOMA-UAV networks, AdaptSky integrates the dueling network (DN) architecture to the DRL technique to improve its learning capabilities. Our findings show that AdaptSky does not only exhibit a fast-adapting learning and outperform the state-of-the-art baseline approach in data rate and fairness, but also it generalizes very well. The AdaptSky source code is accessible to use here: https://github.com/Fouzibenfaid/AdaptSky