Hierarchical Learning for IRS-Assisted MEC Systems with Rate-Splitting Multiple Access

TL;DR

This paper introduces a hierarchical deep reinforcement learning approach to optimize IRS-assisted MEC systems with RSMA, jointly tuning multiple parameters to minimize delay.

Contribution

It proposes a novel hierarchical DRL algorithm with a specialized network architecture for joint optimization in IRS-assisted MEC with RSMA.

Findings

The algorithm converges effectively in simulations.

It outperforms existing benchmark methods.

It reduces average delay in the system.

Abstract

Intelligent reflecting surface (IRS)-assisted mobile edge computing (MEC) systems have shown notable improvements in efficiency, such as reduced latency, higher data rates, and better energy efficiency. However, the resource competition among users will lead to uneven allocation, increased latency, and lower throughput. Fortunately, the rate-splitting multiple access (RSMA) technique has emerged as a promising solution for managing interference and optimizing resource allocation in MEC systems. This paper studies an IRS-assisted MEC system with RSMA, aiming to jointly optimize the passive beamforming of the IRS, the active beamforming of the base station, the task offloading allocation, the transmit power of users, the ratios of public and private information allocation, and the decoding order of the RSMA to minimize the average delay from a novel uplink transmission perspective. Since the formulated problem is non-convex and the optimization variables are highly coupled, we propose a hierarchical deep reinforcement learning-based algorithm to optimize both continuous and discrete variables of the problem. Additionally, to better extract channel features, we design a novel network architecture within the policy and evaluation networks of the proposed algorithm, combining convolutional neural networks and densely connected convolutional network for feature extraction. Simulation results indicate that the proposed algorithm not only exhibits excellent convergence performance but also outperforms various benchmarks.