Simulated Interactive Debugging

TL;DR

This paper introduces Simulated Interactive Debugging, a guided approach using fault localization and language models to teach debugging more effectively to CS students, demonstrated through a small user study.

Contribution

It presents a novel interactive debugging method that combines traditional techniques with large language models for educational purposes.

Findings

Students appreciated systematic guidance and automated breakpoints.

Automated breakpoints were rated as most effective.

Participants found interactive debugging and explanations helpful.

Abstract

Debugging software, i.e., the localization of faults and their repair, is a key activity in software engineering. Therefore, effective and efficient debugging is one of the core skills a software engineer must develop. However, the teaching of debugging techniques is usually very limited or only taught in indirect ways, e.g., during software projects. As a result, most Computer Science (CS) students learn debugging only in an ad-hoc and unstructured way. In this work, we present our approach called Simulated Interactive Debugging that interactively guides students along the debugging process. The guidance aims to empower the students to repair their solutions and have a proper learning experience. We envision that such guided debugging techniques can be integrated into programming courses early in the CS education curriculum. We developed a prototypical implementation using traditional fault localization techniques and large language models. Students can use features like the automated setting of breakpoints or an interactive chatbot. We designed and executed a small-scale, controlled experiment with eight undergraduate CS students. Based on the responses, we conclude that the participants liked the systematic guidance. They rated the automated setting of breakpoints as most effective, followed by the interactive debugging and chatting, and the breakpoint explanations. In future, we will extend our concept and implementation, and perform more intensive user studies.