A statistical testing framework for evaluating the quality of measurement processes

TL;DR

This paper introduces a statistical testing framework using a t-test to evaluate measurement process quality by comparing measurements against reference standards, supported by simulation results.

Contribution

It proposes a novel t-test based evaluation procedure for measurement quality that leverages reference measurements as a gold standard.

Findings

The proposed t-test effectively assesses measurement process quality.

Simulation demonstrates the procedure's reliability and robustness.

The framework offers an alternative to error interval comparison methods.

Abstract

In this paper in which we address the evaluation of measurement process quality, we mainly focus on the evaluation procedure, as far as it is based on the numerical measurement outcomes. We challenge the approach where the "exact" value of the observed quantity is compared to the error interval obtained from the measurements under test and we propose a procedure where reference measurements are used as "gold standard". To this purpose, we designed a specific t-test procedure for this purpose, explained here. We also describe and discuss a numerical simulation experiment demonstrating the behaviour of our procedure.