Energy-Efficient Ultra-Dense Network with Deep Reinforcement Learning

TL;DR

This paper proposes a deep reinforcement learning approach to reduce energy consumption in ultra-dense networks by intelligently managing base station sleep modes, balancing energy efficiency with network performance.

Contribution

It introduces a DRL-based method with a decision selection network to efficiently determine base station modes, reducing computational overhead and energy use.

Findings

Significant energy savings achieved in simulations.

Maintains network throughput and rate requirements.

Reduces computational complexity of mode decision.

Abstract

With the explosive growth in mobile data traffic, ultra-dense network (UDN) where a large number of small cells are densely deployed on top of macro cells has received a great deal of attention in recent years. While UDN offers a number of benefits, an upsurge of energy consumption in UDN due to the intensive deployment of small cells has now become a major bottleneck in achieving the primary goals viz., 100-fold increase in the throughput in 5G+ and 6G. In recent years, an approach to reduce the energy consumption of base stations (BSs) by selectively turning off the lightly-loaded BSs, referred to as the sleep mode technique, has been suggested. However, determining the appropriate active/sleep modes of BSs is a difficult task due to the huge computational overhead and inefficiency caused by the frequent BS mode conversion. An aim of this paper is to propose a deep reinforcement learning (DRL)-based approach to achieve a reduction of energy consumption in UDN. Key ingredient of the proposed scheme is to use decision selection network to reduce the size of action space. Numerical results show that the proposed scheme can significantly reduce the energy consumption of UDN while ensuring the rate requirement of network.