Adaptive Scaffolding in Block-Based Programming via Synthesizing New Tasks as Pop Quizzes

TL;DR

This paper presents a novel framework for adaptive scaffolding in block-based programming education by automatically generating personalized, comprehensible pop quizzes using a new algorithm, PQuizSyn, to support novice learners effectively.

Contribution

The paper introduces PQuizSyn, a new algorithm for synthesizing adaptive, comprehensible, and concealed pop quizzes to enhance scaffolding in block-based programming environments.

Findings

PQuizSyn can generate hundreds of personalized pop quizzes.

Expert ratings confirm the quality of synthesized quizzes.

Initial user study shows improved student engagement.

Abstract

Block-based programming environments are increasingly used to introduce computing concepts to beginners. However, novice students often struggle in these environments, given the conceptual and open-ended nature of programming tasks. To effectively support a student struggling to solve a given task, it is important to provide adaptive scaffolding that guides the student towards a solution. We introduce a scaffolding framework based on pop quizzes presented as multi-choice programming tasks. To automatically generate these pop quizzes, we propose a novel algorithm, PQuizSyn. More formally, given a reference task with a solution code and the student's current attempt, PQuizSyn synthesizes new tasks for pop quizzes with the following features: (a) Adaptive (i.e., individualized to the student's current attempt), (b) Comprehensible (i.e., easy to comprehend and solve), and (c) Concealing (i.e., do not reveal the solution code). Our algorithm synthesizes these tasks using techniques based on symbolic reasoning and graph-based code representations. We show that our algorithm can generate hundreds of pop quizzes for different student attempts on reference tasks from Hour of Code: Maze Challenge and Karel. We assess the quality of these pop quizzes through expert ratings using an evaluation rubric. Further, we have built an online platform for practicing block-based programming tasks empowered via pop quiz based feedback, and report results from an initial user study.