Transcending XAI Algorithm Boundaries through End-User-Inspired Design
Weina Jin, Jianyu Fan, Diane Gromala, Philippe Pasquier, Xiaoxiao Li,, Ghassan Hamarneh

TL;DR
This paper advocates for a shift in XAI research towards end-user needs, proposing new technical problems and evaluation metrics to enhance explainability for non-technical users in high-stakes domains.
Contribution
It introduces four novel XAI technical problems inspired by end-user requirements and discusses open challenges for developing user-centered explainability methods.
Findings
Identified four new XAI problems: edge-case reasoning, customizable counterfactuals, collapsible decision trees, verifiability metrics.
Bridged human-centered XAI with technical XAI, emphasizing the importance of user-focused explainability.
Highlighted open problems and future directions for responsible AI in critical applications.
Abstract
The boundaries of existing explainable artificial intelligence (XAI) algorithms are confined to problems grounded in technical users' demand for explainability. This research paradigm disproportionately ignores the larger group of non-technical end users, who have a much higher demand for AI explanations in diverse explanation goals, such as making safer and better decisions and improving users' predicted outcomes. Lacking explainability-focused functional support for end users may hinder the safe and accountable use of AI in high-stakes domains, such as healthcare, criminal justice, finance, and autonomous driving systems. Built upon prior human factor analysis on end users' requirements for XAI, we identify and model four novel XAI technical problems covering the full spectrum from design to the evaluation of XAI algorithms, including edge-case-based reasoning, customizable…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsExplainable Artificial Intelligence (XAI) · Artificial Intelligence in Healthcare and Education · Ethics and Social Impacts of AI
