Looking for a broader mindset in psychometrics: the case for more participatory measurement practices

TL;DR

The paper suggests involving more people in psychometric practices to improve measurement authenticity in psychology.

Contribution

Proposes participatory measurement practices as a novel approach to address psychometrics' limitations.

Findings

Current psychometrics solutions focus on statistical best practices without addressing earlier measurement pitfalls.

Involving practitioners and participants could lead to more authentic psychological measurements.

A complete overhaul of psychometrics may leave practitioners without quantitative tools for a long time.

Abstract

Psychometrics and the consequences of its use as the method of quantitative empirical psychology has been continuously criticized by both psychologists and psychometrists. However, the scope of the possible solutions to these issues has been mostly focused on the establishment of methodological-statistical best practices for researchers, without any regard to the pitfalls of previous stages of measurement as well as theory development of the targeted phenomenon. Conversely, other researchers advance the idea that, since psychometrics is riddled with many issues, the best way forward is a complete rework of the discipline even if it leaves psychologists and other practitioners without any way to measure quantitatively for a long period of time. Given these tensions, we therefore advocate for an alternative path to consider while we work on making substantive change in measurement. We propose a set of research practices focusing on the inclusion and active participation of groups involved in measurement activities, such as psychometrists, researchers but most importantly practitioners and potential participants. Involving a wider community while measuring in psychology could tackle some key issues that would take us closer to a more authentic approach to our phenomenon of interest.