ACCoRD: Actor-Critic Conflict Resolution with Deep learning for O-RAN xApps

TL;DR

The paper introduces ACCoRD, a deep learning-based conflict resolution method for O-RAN networks that improves control decision efficiency using reinforcement learning and simulation-based evaluation.

Contribution

It presents a novel ANN-based conflict resolution approach for O-RAN, trained with reinforcement learning, and proposes a new evaluation methodology.

Findings

Reduces negative network events in medium and high traffic scenarios.

Outperforms rule-based approaches in conflict mitigation.

Uses reinforcement learning for adaptive conflict resolution.

Abstract

Conflict Mitigation (ConMit) is a crucial part of intelligent network control in Open Radio Access Networks (O-RAN). In this paper, we propose a method named ACCoRD to resolve detected control conflicts in Near-Real Time RAN Intelligent Controller using a Conflict Resolution (CR) Agent with an Artificial Neural Network (ANN) trained with a reinforcement learning algorithm PPO-Clip. The implemented ANN analyzes data about the network and conflicting control decisions to infer optimal CR actions. The CR Agent gathers feedback from the network after each resolved conflict to assess its efficiency and adjust the ANN's weights during batch training. The evaluation of the proposed approach is based on simulation data. A new methodology for evaluating CR solutions is proposed. Results show that the proposed ANN-based method improves on the efficiency of rule-based approaches by significantly reducing negative network events caused by conflicting control decisions in medium and high traffic scenarios.