Examining Student and AI Generated Personalized Analogies in Introductory Physics

TL;DR

This study investigates how students and AI generate personalized analogies in physics explanations, revealing differences in analogy use and exploring AI's potential to support student reasoning.

Contribution

It provides a comparative analysis of student and AI-generated analogies in physics, highlighting challenges and opportunities for AI to enhance personalized learning.

Findings

Students rarely use analogies spontaneously in explanations.

Students employ diverse analogies when explicitly prompted.

AI responses differ from student analogies in content and style.

Abstract

Comparing abstract concepts (such as electric circuits) with familiar ideas (plumbing systems) through analogies is central to practice and communication of physics. Contemporary research highlights self-generated analogies to better facilitate students' learning than the taught ones. "Spontaneous" and "self-generated" analogies represent the two ways through which students construct personalized analogies. However, facilitating them, particularly in large enrollment courses remains a challenge, and recent developments in generative artificial intelligence (AI) promise potential to address this issue. In this qualitative study, we analyze around 800 student responses in exploring the extent to which students spontaneously leverage analogies while explaining Morse potential curve in a language suitable for second graders and self-generate analogies in their preferred everyday contexts. We also compare the student-generated spontaneous analogies with AI-generated ones prompted by students. Lastly, we explore the themes associated with students' perceived ease and difficulty in generating analogies across both cases. Results highlight that unlike AI responses, student-generated spontaneous explanations seldom employ analogies. However, when explicitly asked to explain the behavior of the curve in terms of their everyday contexts, students employ diverse analogical contexts. A combination of disciplinary knowledge, agency to generate customized explanations, and personal attributes tend to influence students' perceived ease in generating explanations across the two cases. Implications of these results on the potential of AI to facilitate students' personalized analogical reasoning, and the role of analogies in making students notice gaps in their understanding are discussed.