Don't Explain Noise: Robust Counterfactuals for Randomized Ensembles

TL;DR

This paper introduces a method for generating robust counterfactual explanations for randomized ensemble models, ensuring higher validity and stability of explanations with minimal additional distance.

Contribution

It formalizes the problem of robust counterfactuals for ensembles, links ensemble robustness to base learner robustness, and provides a practical method with theoretical guarantees.

Findings

Existing methods have less than 50% validity for naive counterfactuals.

Robust counterfactuals achieve higher validity, up to 80-90%.

The proposed method maintains low distance increase from initial observations.

Abstract

Counterfactual explanations describe how to modify a feature vector in order to flip the outcome of a trained classifier. Obtaining robust counterfactual explanations is essential to provide valid algorithmic recourse and meaningful explanations. We study the robustness of explanations of randomized ensembles, which are always subject to algorithmic uncertainty even when the training data is fixed. We formalize the generation of robust counterfactual explanations as a probabilistic problem and show the link between the robustness of ensemble models and the robustness of base learners. We develop a practical method with good empirical performance and support it with theoretical guarantees for ensembles of convex base learners. Our results show that existing methods give surprisingly low robustness: the validity of naive counterfactuals is below $50\%$ on most data sets and can fall to $20\%$ on problems with many features. In contrast, our method achieves high robustness with only a small increase in the distance from counterfactual explanations to their initial observations.