Multi-Generator Continual Learning for Robust Delay Prediction in 6G

TL;DR

This paper introduces a multi-generator continual learning approach using TVAE for robust one-way delay prediction in 6G networks, addressing catastrophic forgetting in dynamic environments.

Contribution

It proposes a novel multi-generator generative replay framework with TVAE, incorporating domain knowledge to improve delay prediction in 6G network scenarios.

Findings

Outperforms baseline models in delay prediction accuracy.

Effectively mitigates catastrophic forgetting in continual learning.

Validated on realistic 5G testbed data.

Abstract

In future 6G networks, dependable networks will enable telecommunication services such as remote control of robots or vehicles with strict requirements on end-to-end network performance in terms of delay, delay variation, tail distributions, and throughput. With respect to such networks, it is paramount to be able to determine what performance level the network segment can guarantee at a given point in time. One promising approach is to use predictive models trained using machine learning (ML). Predicting performance metrics such as one-way delay (OWD), in a timely manner, provides valuable insights for the network, user equipments (UEs), and applications to address performance trends, deviations, and violations. Over the course of time, a dynamic network environment results in distributional shifts, which causes catastrophic forgetting and drop of ML model performance. In continual learning (CL), the model aims to achieve a balance between stability and plasticity, enabling new information to be learned while preserving previously learned knowledge. In this paper, we target on the challenges of catastrophic forgetting of OWD prediction model. We propose a novel approach which introducing the concept of multi-generator for the state-of-the-art CL generative replay framework, along with tabular variational autoencoders (TVAE) as generators. The domain knowledge of UE capabilities is incorporated into the learning process for determining generator setup and relevance. The proposed approach is evaluated across a diverse set of scenarios with data that is collected in a realistic 5G testbed, demonstrating its outstanding performance in comparison to baselines.