Enhancing Fault Diagnosis in GWAC: A Monitoring System for Telescope Arrays

TL;DR

This paper presents a comprehensive monitoring system for GWAC telescope arrays that significantly improves fault diagnosis speed and accuracy, achieving near real-time fault localization and demonstrating high generalizability.

Contribution

The paper introduces a novel multi-view monitoring system architecture that enhances fault diagnosis efficiency and speed in complex telescope array operations.

Findings

Fault localization speed increased nearly tenfold

System can identify and localize faults within minutes

High generalizability to other telescope systems

Abstract

The Ground-based Wide-Angle Cameras array (GWAC) necessitates the integration of over 100 hardware devices, more than 100 servers, and upwards of 2500 software modules, all synchronized within a 3-second imaging cycle. However, the complexity of real-time and high concurrency processing of big data have historically resulted in a substantial failure rate, with estimated observation efficiency of less than 50% in 2023. To address these challenges, we developed a monitoring system aimed at enhancing fault diagnosis efficiency. The system features two innovative monitoring views: state evolution monitoring and transient lifecycle monitoring. These, combined with instantaneous state monitoring and key parameter monitoring views, create a comprehensive and holistic monitoring strategy. This paper details the system's architecture, data collection methods, and the design philosophy of monitoring views. After a year of practical fault diagnostics, the system has demonstrated the ability to identify and localize faults within minutes, achieving fault localization speeds nearly ten times faster than traditional methods. Additionally, the system's design exhibits high generalizability, making them applicable to other telescope array systems.