Assessing the Students' Understanding and their Mistakes in Code Review Checklists -- An Experience Report of 1,791 Code Review Checklist Questions from 394 Students
Chun Yong Chong, Patanamon Thongtanunam, Chakkrit Tantithamthavorn

TL;DR
This study analyzes how students create and use code review checklists to identify defects, revealing their misconceptions and demonstrating that checklist development can enhance analytical skills in software engineering education.
Contribution
It provides empirical evidence that students can develop effective code review checklists despite limited experience, supporting checklist creation as a valuable educational activity.
Findings
Students can anticipate potential defects using checklists.
Students have misconceptions about the purpose of code review.
Checklist development helps scaffold students' analytical skills.
Abstract
Code review is a widely-used practice in software development companies to identify defects. Hence, code review has been included in many software engineering curricula at universities worldwide. However, teaching code review is still a challenging task because the code review effectiveness depends on the code reading and analytical skills of a reviewer. While several studies have investigated the code reading techniques that students should use to find defects during code review, little has focused on a learning activity that involves analytical skills. Indeed, developing a code review checklist should stimulate students to develop their analytical skills to anticipate potential issues (i.e., software defects). Yet, it is unclear whether students can anticipate potential issues given their limited experience in software development (programming, testing, etc.). We perform a qualitative…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
