A new model test in high energy physics in frequentist and Bayesian statistical formalisms

TL;DR

This paper compares frequentist and Bayesian statistical methods for testing new physical models in high energy physics experiments, demonstrating their consistency and analyzing the impact of systematic uncertainties.

Contribution

It introduces a unified approach to model testing in HEP using both statistical formalisms and compares their results under systematic uncertainties.

Findings

Both approaches yield consistent results.

Systematic uncertainties significantly affect model testing.

The methods are applicable to general experimental situations.

Abstract

A problem of a new physical model test given observed experimental data is a typical one for modern experiments of high energy physics (HEP). A solution of the problem may be provided with two alternative statistical formalisms, namely frequentist and Bayesian, which are widely spread in contemporary HEP searches. A characteristic experimental situation is modeled from general considerations and both the approaches are utilized in order to test a new model. The results are juxtaposed, what demonstrates their consistency in this work. An effect of a systematic uncertainty treatment in the statistical analysis is also considered.