Explanation Needs in App Reviews: Taxonomy and Automated Detection
Max Unterbusch, Mersedeh Sadeghi, Jannik Fischbach, Martin Obaidi,, Andreas Vogelsang

TL;DR
This paper investigates users' explanation needs in app reviews, creating a taxonomy and developing automated methods to identify these needs, thereby aiding developers in improving explainability features.
Contribution
It introduces a taxonomy of explanation needs in app reviews and presents an effective classifier for automatic detection of these needs.
Findings
Best classifier achieves 86% F-score on unseen reviews
Manual coding of 1,730 reviews led to a comprehensive taxonomy
Automated detection can support eliciting explanation requirements
Abstract
Explainability, i.e. the ability of a system to explain its behavior to users, has become an important quality of software-intensive systems. Recent work has focused on methods for generating explanations for various algorithmic paradigms (e.g., machine learning, self-adaptive systems). There is relatively little work on what situations and types of behavior should be explained. There is also a lack of support for eliciting explainability requirements. In this work, we explore the need for explanation expressed by users in app reviews. We manually coded a set of 1,730 app reviews from 8 apps and derived a taxonomy of Explanation Needs. We also explore several approaches to automatically identify Explanation Needs in app reviews. Our best classifier identifies Explanation Needs in 486 unseen reviews of 4 different apps with a weighted F-score of 86%. Our work contributes to a better…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSoftware Engineering Research · Software System Performance and Reliability · Software Engineering Techniques and Practices
