Modelling resource allocation in uncertain system environment through deep reinforcement learning

TL;DR

This paper explores how deep reinforcement learning can improve resource allocation in uncertain environments, demonstrating a novel approach that adapts better than traditional methods and achieves high efficiency in simulations.

Contribution

It introduces a modified deep reinforcement learning architecture with noisy layers, prioritized replay, and duelling networks for resource allocation under uncertainty, showing improved performance.

Findings

Achieved 97.7% efficiency in simulated resource allocation tasks.

Demonstrated the effectiveness of Noisy Bagging duelling double deep Q network.

Provided a comparative analysis of various deep RL methods.

Abstract

Reinforcement Learning has applications in field of mechatronics, robotics, and other resource-constrained control system. Problem of resource allocation is primarily solved using traditional predefined techniques and modern deep learning methods. The drawback of predefined and most deep learning methods for resource allocation is failing to meet the requirements in cases of uncertain system environment. We can approach problem of resource allocation in uncertain system environment alongside following certain criteria using deep reinforcement learning. Also, reinforcement learning has ability for adapting to new uncertain environment for prolonged period of time. The paper provides a detailed comparative analysis on various deep reinforcement learning methods by applying different components to modify architecture of reinforcement learning with use of noisy layers, prioritized replay, bagging, duelling networks, and other related combination to obtain improvement in terms of performance and reduction of computational cost. The paper identifies problem of resource allocation in uncertain environment could be effectively solved using Noisy Bagging duelling double deep Q network achieving efficiency of 97.7% by maximizing reward with significant exploration in given simulated environment for resource allocation.