Exploring the Design and Impact of Interactive Worked Examples for Learners with Varying Prior Knowledge

TL;DR

This study designs two types of interactive worked examples based on ICAP theory and demonstrates their effectiveness in improving logic problem solving for learners with different prior knowledge levels.

Contribution

It introduces Buggy and Guided worked examples tailored to cognitive engagement levels and applies behavior analysis to compare learner interactions.

Findings

Both examples improved posttest performance.

Buggy helped high prior knowledge learners.

Guided benefited low prior knowledge learners.

Abstract

Tutoring systems improve learning through tailored interventions, such as worked examples, but often suffer from the aptitude-treatment interaction effect where low prior knowledge learners benefit more. We applied the ICAP learning theory to design two new types of worked examples, Buggy (students fix bugs), and Guided (students complete missing rules), requiring varying levels of cognitive engagement, and investigated their impact on learning in a controlled experiment with 155 undergraduate students in a logic problem solving tutor. Students in the Buggy and Guided examples groups performed significantly better on the posttest than those receiving passive worked examples. Buggy problems helped high prior knowledge learners whereas Guided problems helped low prior knowledge learners. Behavior analysis showed that Buggy produced more exploration-revision cycles, while Guided led to more help-seeking and fewer errors. This research contributes to the design of interventions in logic problem solving for varied levels of learner knowledge and a novel application of behavior analysis to compare learner interactions with the tutor.