Reinforcement Learning for Rate Maximization in IRS-aided OWC Networks

TL;DR

This paper explores using reinforcement learning to optimize the placement of access points and intelligent reflecting surfaces in indoor optical wireless networks, significantly boosting data rates and ensuring service continuity.

Contribution

It introduces a novel RL-based approach for real-time joint optimization of APs and IRS mirror elements in OWC systems, outperforming traditional allocation methods.

Findings

RL algorithms achieve near-optimal sum rate maximization.

Proposed scheme increases data rate by up to 45%.

RL-based solutions outperform distance-based schemes.

Abstract

Optical wireless communication (OWC) is envisioned as one of the main enabling technologies of 6G networks, complementing radio frequency (RF) systems to provide high data rates. One of the crucial issues in indoor OWC is service interruptions due to blockages that obstruct the line of sight (LoS) between users and their access points (APs). Recently, reflecting surfaces referred to as intelligent reflecting surfaces (IRSs) have been considered to provide improved connectivity in OWC systems by reflecting AP signals toward users. In this study, we investigate the integration of IRSs into an indoor OWC system to improve the sum rate of the users and to ensure service continuity. We formulate an optimization problem for sum rate maximization, where the allocation of both APs and mirror elements of IRSs to users is determined to enhance the aggregate data rate. Moreover, reinforcement learning (RL) algorithms, specifically Q-learning and SARSA algorithms, are proposed to provide real-time solutions with low complexity and without prior system knowledge. The results show that the RL algorithms achieve near-optimal solutions that are close to the solutions of mixed integer linear programming (MILP). The results also show that the proposed scheme achieves up to a 45% increase in data rate compared to a traditional scheme that optimizes only the allocation of APs while the mirror elements are assigned to users based on the distance.