Fraud detection with statistics: A comment on "Evidential Value in ANOVA-Regression Results in Scientific Integrity Studies" (Klaassen, 2015)

TL;DR

This paper critically reviews Klaassen's ANOVA-based data manipulation detection method and proposes an alternative approach for testing sample correlations across multiple experiments, emphasizing the need for multiple similar experiments for reliability.

Contribution

It provides a critical analysis of Klaassen's method and introduces a new correlation-based approach for detecting data manipulation in scientific studies.

Findings

Klaassen's method is effective with multiple experiments.

Single-experiment correlation tests are unreliable.

The new approach aligns with whistleblower reports.

Abstract

Klaassen in (Klaassen 2015) proposed a method for the detection of data manipulation given the means and standard deviations for the cells of a oneway ANOVA design. This comment critically reviews this method. In addition, inspired by this analysis, an alternative approach to test sample correlations over several experiments is derived. The results are in close agreement with the initial analysis reported by an anonymous whistlelblower. Importantly, the statistic requires several similar experiments; a test for correlations between 3 sample means based on a single experiment must be considered as unreliable.