Using Logs to support Programming Education

TL;DR

This paper introduces a real-time logging plugin for code editors to collect granular learning analytics, enabling data-driven insights into programming education and supporting personalized instruction.

Contribution

It presents a novel, granular data collection method for programming education using a code editor plugin, bridging industry practices with pedagogical research.

Findings

Collected real-time logs of coding behaviors and errors

Enabled evaluation of student comprehension and progress

Provided a foundation for educational benchmarking and research

Abstract

Software developers use metrics to evaluate code quality and productivity, but these practices are still rare in programming education. This project bridges the gap by collecting real-time learning analytics from individual student and whole-class code development logs. This granular, quantitative data provides educators with qualitative insights into the learning process. It allows them to evaluate student comprehension, identify common challenges, and critically assess whether the allocated time for exercises and algorithms is sufficient for mastery. Unlike traditional Learning Management Systems, we propose a novel approach: a plugin for a widely used code editor that captures granular interactions during programming and documentation. The resulting dataset logs coding behaviors, errors, and progress, enabling evidence-based analysis of learning patterns and educational benchmarking. By structuring this real-time programming trail, we support research on teaching methodologies, learner challenges, and skill acquisition. Quantitative metrics complement qualitative assessment by evaluating code, exercise progress, and timestamp logs. Our goal is to provide an open-access database for educators and researchers, fostering data-driven insights to enhance instruction and personalize learning experiences. This work aligns industrial best practices with pedagogical innovation, advancing measurable, empirical approaches to programming education.