Explaining Explaining
Sergei Nirenburg, Marjorie McShane, Kenneth W. Goodman, Sanjay, Oruganti

TL;DR
This paper advocates for a hybrid AI approach combining knowledge-based systems with machine learning to enhance explainability and support human decision-making in high-stakes environments.
Contribution
It introduces a hybrid cognitive agent framework that integrates knowledge-based and machine learning components to improve explanation capabilities for human-AI collaboration.
Findings
Demonstrated the explanatory potential of hybrid agents in a simulated robot search task.
Highlighted the limitations of current XAI and HCXAI approaches in real-world critical domains.
Proposed a human-centered, hybrid AI architecture for better explanations and trust.
Abstract
Explanation is key to people having confidence in high-stakes AI systems. However, machine-learning-based systems -- which account for almost all current AI -- can't explain because they are usually black boxes. The explainable AI (XAI) movement hedges this problem by redefining "explanation". The human-centered explainable AI (HCXAI) movement identifies the explanation-oriented needs of users but can't fulfill them because of its commitment to machine learning. In order to achieve the kinds of explanations needed by real people operating in critical domains, we must rethink how to approach AI. We describe a hybrid approach to developing cognitive agents that uses a knowledge-based infrastructure supplemented by data obtained through machine learning when applicable. These agents will serve as assistants to humans who will bear ultimate responsibility for the decisions and actions of…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsScientific Computing and Data Management · Semantic Web and Ontologies
