Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyond

TL;DR

Quantus is an open-source Python toolkit designed to systematically evaluate and compare neural network explanation methods, enhancing transparency and reproducibility in explainable AI research.

Contribution

The paper introduces Quantus, a comprehensive toolkit with evaluation metrics and tutorials, filling a gap in tools available for assessing explanation methods in neural networks.

Findings

Toolkit is thoroughly tested and validated.

Provides a growing collection of evaluation metrics.

Enhances transparency and reproducibility in XAI evaluation.

Abstract

The evaluation of explanation methods is a research topic that has not yet been explored deeply, however, since explainability is supposed to strengthen trust in artificial intelligence, it is necessary to systematically review and compare explanation methods in order to confirm their correctness. Until now, no tool with focus on XAI evaluation exists that exhaustively and speedily allows researchers to evaluate the performance of explanations of neural network predictions. To increase transparency and reproducibility in the field, we therefore built Quantus -- a comprehensive, evaluation toolkit in Python that includes a growing, well-organised collection of evaluation metrics and tutorials for evaluating explainable methods. The toolkit has been thoroughly tested and is available under an open-source license on PyPi (or on https://github.com/understandable-machine-intelligence-lab/Quantus/).