Taking Advice from ChatGPT
Peter Zhang

TL;DR
This study investigates how students incorporate advice from ChatGPT across various topics, revealing factors influencing trust and highlighting the importance of familiarity and experience with AI advice.
Contribution
It provides empirical evidence on the factors affecting advice weighting from ChatGPT, including familiarity, experience, and advice accuracy, with insights into user calibration.
Findings
Participants trust advice more when unfamiliar with topics.
Experience with ChatGPT increases reliance on AI advice.
Students misjudge ChatGPT's accuracy, leading to under-trusting it.
Abstract
A growing literature studies how humans incorporate advice from algorithms. This study examines an algorithm with millions of daily users: ChatGPT. In a preregistered study, 118 student participants answer 2,828 multiple-choice questions across 25 academic subjects. Participants receive advice from a GPT model and can update their initial responses. The advisor's identity ("AI chatbot" versus a human "expert"), presence of a written justification, and advice correctness do not significantly affect weight on advice. Instead, participants weigh advice more heavily if they (1) are unfamiliar with the topic, (2) used ChatGPT in the past, or (3) received more accurate advice previously. The last two effects -- algorithm familiarity and experience -- are stronger with an AI chatbot as the advisor. Participants that receive written justifications are able to discern correct advice and update…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsArtificial Intelligence in Healthcare and Education · Explainable Artificial Intelligence (XAI) · Ethics and Social Impacts of AI
