AOI: Context-Aware Multi-Agent Operations via Dynamic Scheduling and Hierarchical Memory Compression

TL;DR

AOI introduces a multi-agent framework with dynamic scheduling and hierarchical memory compression to enhance context-aware operations in complex cloud-native IT infrastructures, significantly improving efficiency and fault management.

Contribution

The paper presents a novel multi-agent system with a context compressor and adaptive scheduling, enabling scalable and efficient management of dynamic cloud-native environments.

Findings

Achieves 72.4% context compression while retaining 92.8% critical information.

Improves task success rate to 94.2%.

Reduces mean time to recovery (MTTR) by 34.4%.

Abstract

The proliferation of cloud-native architectures, characterized by microservices and dynamic orchestration, has rendered modern IT infrastructures exceedingly complex and volatile. This complexity generates overwhelming volumes of operational data, leading to critical bottlenecks in conventional systems: inefficient information processing, poor task coordination, and loss of contextual continuity during fault diagnosis and remediation. To address these challenges, we propose AOI (AI-Oriented Operations), a novel multi-agent collaborative framework that integrates three specialized agents with an LLM-based Context Compressor. Its core innovations include: (1) a dynamic task scheduling strategy that adaptively prioritizes operations based on real-time system states, (2) a three-layer memory architecture comprising Working, Episodic, and Semantic layers that optimizes context retention and retrieval. Extensive experiments on synthetic and real-world benchmarks show that AOI achieves 72.4\% context compression while preserving 92.8\% critical information, improves task success to 94.2\%, and reduces MTTR by 34.4\% over the best baseline. This work presents a paradigm shift towards scalable, adaptive, and context-aware autonomous operations, enabling robust management of next-generation IT infrastructures with minimal human intervention.