Conceptualizing and Evaluating Replication Across Domains of Behavioral Research

TL;DR

This paper proposes a broader conceptualization of replication in behavioral research, critiques the traditional direct versus conceptual replication dichotomy, and advocates for advanced statistical models to evaluate replication results.

Contribution

It introduces a generalized framework for understanding replication across psychological research domains and recommends hierarchical and meta-analytic models for evaluation.

Findings

Broader replication framework enhances understanding across domains

Hierarchical models improve evaluation of replication success

Critique of dichotomous statistical paradigms in replication studies

Abstract

We discuss the authors' conceptualization of replication, in particular the false dichotomy of direct versus conceptual replication intrinsic to it, and suggest a broader one that better generalizes to other domains of psychological research. We also discuss their approach to the evaluation of replication results and suggest moving beyond their dichotomous statistical paradigms and employing hierarchical / meta-analytic statistical models.