Monitoring the calibration of probability forecasts with an application to concept drift detection involving image classification

TL;DR

This paper introduces a cumulative sum-based method with dynamic limits for monitoring the calibration of probability forecasts in image classification, enabling early detection of model miscalibration and concept drift without needing access to the model internals.

Contribution

It presents a novel, model-agnostic approach for real-time calibration monitoring applicable to various operational settings and concept drift scenarios.

Findings

Effective detection of miscalibration in image classifiers

Applicable to real-time operational monitoring

Operates without access to model internals

Abstract

Machine learning approaches for image classification have led to impressive advances in that field. For example, convolutional neural networks are able to achieve remarkable image classification accuracy across a wide range of applications in industry, defense, and other areas. While these machine learning models boast impressive accuracy, a related concern is how to assess and maintain calibration in the predictions these models make. A classification model is said to be well calibrated if its predicted probabilities correspond with the rates events actually occur. While there are many available methods to assess machine learning calibration and recalibrate faulty predictions, less effort has been spent on developing approaches that continually monitor predictive models for potential loss of calibration as time passes. We propose a cumulative sum-based approach with dynamic limits that enable detection of miscalibration in both traditional process monitoring and concept drift applications. This enables early detection of operational context changes that impact image classification performance in the field. The proposed chart can be used broadly in any situation where the user needs to monitor probability predictions over time for potential lapses in calibration. Importantly, our method operates on probability predictions and event outcomes and does not require under-the-hood access to the machine learning model.