AI Persuasion, Bayesian Attribution, and Career Concerns of Decision-Makers
Hanzhe Li, Jin Li, Ye Luo, Xiaowei Zhang

TL;DR
This paper explores how AI persuades decision-makers by analyzing attention and comprehension differences, revealing that AI interpretability influences persuasion effectiveness and decision accuracy, especially when career concerns are involved.
Contribution
It introduces a distinction between attention and comprehension disagreements in AI persuasion and shows that reducing AI interpretability can sometimes enhance persuasion and decision outcomes.
Findings
AI persuades more effectively when disagreement is due to attention differences.
Uninterpretable AI can increase persuasion and improve decision accuracy.
Interpretability affects how decision-makers attribute disagreement sources.
Abstract
This paper studies AI persuasion by distinguishing between two reasons for disagreement: attention differences, where the AI detects features the decision-maker missed, and comprehension differences, where the AI and the decision-maker interpret observed features differently. We show that AI is more effective in persuading the decision-maker when the disagreement is due to attention differences rather than comprehension differences. We also show that the AI's interpretability shapes how the decision-maker attributes the sources of disagreement and, in turn, whether they follow the AI's recommendation. Our main result is that making AI uninterpretable can actually enhance persuasion and, in the presence of career concerns, improve decision accuracy.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsArtificial Intelligence in Healthcare and Education
MethodsSoftmax · Attention Is All You Need
