Control and Monitoring of Artificial Intelligence Algorithms
Carlos Mario Braga Ortu\~no, Blanca Martinez Donoso, Bel\'en, Mu\~niz Villanueva

TL;DR
This paper emphasizes the importance of monitoring AI models after deployment, focusing on data and concept drift, and introduces metrics to evaluate model performance amid distributional changes.
Contribution
It provides a comprehensive overview of data and concept drift, and proposes metrics for monitoring AI models in dynamic environments.
Findings
Identifies key types of drift affecting AI models.
Introduces metrics for detecting performance fluctuations.
Highlights the importance of ongoing model oversight.
Abstract
This paper elucidates the importance of governing an artificial intelligence model post-deployment and overseeing potential fluctuations in the distribution of present data in contrast to the training data. The concepts of data drift and concept drift are explicated, along with their respective foundational distributions. Furthermore, a range of metrics is introduced, which can be utilized to scrutinize the model's performance concerning potential temporal variations.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsData Stream Mining Techniques · Air Quality Monitoring and Forecasting
