Monitoring AI systems: A Problem Analysis, Framework and Outlook

TL;DR

This paper explores using knowledge-based systems to monitor AI systems in operation, providing a problem analysis, a structured framework for future research, and discussing potential research directions.

Contribution

It introduces a novel application of knowledge-based systems for monitoring AI systems, along with a structured framework and research directions.

Findings

Proposes a new monitoring approach for AI systems.

Provides a comprehensive problem analysis.

Suggests future research directions.

Abstract

Knowledge-based systems have been used to monitor machines and processes in the real world. In this paper we propose the use of knowledge-based systems to monitor other AI systems in operation. We motivate and provide a problem analysis of this novel setting and subsequently propose a framework that allows for structuring future research related to this setting. Several directions for further research are also discussed.