Characterizing lab instructors' self-reported learning goals to inform development of an experimental modeling skills assessment

TL;DR

This study explores lab instructors' learning goals related to modeling in upper-division physics labs to inform the development of assessments for evaluating students' model-based reasoning skills.

Contribution

It is the first to identify key modeling subskills valued by instructors in optics and electronics labs for assessment development.

Findings

Instructors value multiple modeling subtasks as learning outcomes.

Test items should assess students' ability to justify modeling choices.

Modeling skills are recognized as important across various lab contexts.

Abstract

The ability to develop, use, and refine models of experimental systems is a nationally recognized learning outcome for undergraduate physics lab courses. However, no assessments of students' model-based reasoning exist for upper-division labs. This study is the first step toward development of modeling assessments for optics and electronics labs. In order to identify test objectives that are likely relevant across many institutional contexts, we interviewed 35 lab instructors about the ways they incorporate modeling in their course learning goals and activities. The study design was informed by the Modeling Framework for Experimental Physics. This framework conceptualizes modeling as consisting of multiple subtasks: making measurements, constructing system models, comparing data to predictions, proposing causes for discrepancies, and enacting revisions to models or apparatus. We found that each modeling subtask was identified by multiple instructors as an important learning outcome for their course. Based on these results, we argue that test objectives should include probing students' competence with most modeling subtasks, and test items should be designed to elicit students' justifications for choosing particular modeling pathways. In addition to discussing these and other implications for assessment, we also identify future areas of research related to the role of modeling in optics and electronics labs.