EventADL: Open-Box Anomaly Detection and Localization Framework for Events in Cloud-Based Service Systems

TL;DR

EventADL is an innovative open-box framework for anomaly detection and root cause localization in cloud systems, utilizing event data to improve reliability and interpretability.

Contribution

It introduces a novel event-based ADL framework with patterns and intervention graphs, filling a gap left by metric and log data-focused methods.

Findings

Achieves at least 90% F1-score in anomaly detection

Attains 100% top-3 accuracy in root cause localization

Outperforms existing methods on real cloud service data

Abstract

Anomaly detection and localization (ADL) is critical for maintaining reliability and availability in cloud systems. Recent ADL developments focus on metric and log data, leaving event data unexplored. To address this gap, we propose EventADL, the first open-box event-based ADL framework for cloud-based service systems. To motivate the design of our framework, we conduct a systematic analysis on 520 real-world incidents, and provide insights into how anomalies and their root causes manifest through event data. EventADL has three phases: offline training, online anomaly detection, and root cause localization. During the training phase, EventADL first learns Event Semantic Patterns (ESPs), which capture normal interactions between system entities using historical event data, and then learns Event Frequency Patterns (EFPs), which capture the normal frequency of known ESPs. In the online anomaly detection phase, any data in the event stream that deviates significantly from either pattern is identified as anomalous. For localization, EventADL constructs an Intervention Graph that models the relationships between recent system interactions and the detected anomalies for automatic root cause localization. The framework is designed to operate efficiently with unlabeled data and to produce interpretable anomalies with their corresponding root causes. Our evaluation on three real cloud service systems and two real-world incidents demonstrates that EventADL outperforms existing methods, achieving F1-scores of at least 90% for anomaly detection and 100% top-3 accuracy in root cause localization.