Discriminative Attribution from Counterfactuals
Nils Eckstein, Alexander S. Bates, Gregory S.X.E. Jefferis, Jan Funke

TL;DR
This paper introduces a novel neural network interpretability method combining feature attribution with counterfactual explanations to produce discriminative attribution maps, enabling objective evaluation of attribution quality.
Contribution
It presents a new approach that integrates counterfactuals with feature attribution, improving interpretability and providing a quantitative assessment framework.
Findings
The method produces more discriminative features than conventional attribution methods.
It effectively evaluates attribution methods objectively, reducing observer bias.
The approach works well across diverse datasets, including biological data.
Abstract
We present a method for neural network interpretability by combining feature attribution with counterfactual explanations to generate attribution maps that highlight the most discriminative features between pairs of classes. We show that this method can be used to quantitatively evaluate the performance of feature attribution methods in an objective manner, thus preventing potential observer bias. We evaluate the proposed method on three diverse datasets, including a challenging artificial dataset and real-world biological data. We show quantitatively and qualitatively that the highlighted features are substantially more discriminative than those extracted using conventional attribution methods and argue that this type of explanation is better suited for understanding fine grained class differences as learned by a deep neural network.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsExplainable Artificial Intelligence (XAI) · Domain Adaptation and Few-Shot Learning · Machine Learning and Data Classification
