Scientific Auditing Firms

TL;DR

The paper proposes establishing scientific auditing firms that utilize data analytics to conduct random audits of scientific literature, aiming to improve reproducibility and integrity across disciplines.

Contribution

It introduces the novel concept of scientific auditing firms using data analytics for literature review and proposes a mock trial to assess feasibility.

Findings

Mock trial provides insights into audit process feasibility

Data analytics can identify key results for targeted investigation

Auditing firms could enhance scientific reproducibility

Abstract

The "crisis of reproducibility" has been a significant source of controversy, heated debate, and calls for reform to institutional science in recent years. As a long-term solution to address both the present crisis and future obstacles, I propose the creation of a new form of research organization whose purpose would be to conduct random audits of the scientific literature. I suggest that data analytics of a digitized scientific corpus may play a critical role in allowing broadly educated scientists to identify linchpin results to investigate in further detail across all disciplines. I argue that a simple "mock" trial run of a simplified auditing firm consisting of several researchers over a short time period would provide valuable insight into the feasibility of this proposal.