Bridging the Disciplinary Gap in Explainable AI: From Abstract Desiderata to Concrete Tasks

TL;DR

The paper proposes a structured approach using a taxonomy and framework to translate abstract desiderata in explainable AI into concrete, benchmarkable tasks, addressing the fragmentation in the field.

Contribution

It introduces a three-axis taxonomy and a three-step framework to systematically derive well-scoped XAI tasks from high-level desiderata.

Findings

The taxonomy helps clarify and organize desiderata dependencies.

The framework guides the creation of concrete, benchmarkable XAI tasks.

Case studies demonstrate the approach's utility in systematic task design.

Abstract

Explainable AI (XAI) is often criticized for failing to satisfy broad desiderata (e.g., fairness, accountability) and for limited practical value to stakeholders. This challenge partly arises because researchers across disciplines prioritize different sets of desiderata that remain underspecified and context-dependent, yet expect XAI to satisfy them simultaneously, resulting in fragmented and sometimes incompatible operationalizations. We argue that many desiderata are not independent, but instead form dependency structures in which higher-level goals (\emph{e.g.}, trust, accountability) rely on more foundational properties (\emph{e.g.}, faithfulness, robustness). Some desiderata are multi-faceted and are best understood within these structures. In particular, instead of addressing all desiderata at once, we focus on subsets of dependency structures and translate them into concrete XAI tasks, thereby decomposing research questions into benchmarkable and solvable units. To this end, we propose a three-axis taxonomy (\emph{target}, \emph{functional role}, and \emph{mode of justification}) and a three-step framework for deriving well-scoped, benchmarkable XAI tasks. Our approach builds on a systematic literature review and conceptual analysis, and supports clarifying desiderata, identifying dependencies, scoping feasibility, and delimiting the design space to derive concrete XAI tasks from abstract desiderata. We illustrate its utility through two explanatory cases, showing how the taxonomy and framework guide systematic task design and evaluation in XAI. {\color{red}{This is a preprint of a paper that will appear in AISoLA 2026.}}