On the Birnbaum Argument for the Strong Likelihood Principle

TL;DR

This paper critically examines Birnbaum's argument linking the Weak Conditionality Principle and sufficiency to the Strong Likelihood Principle, highlighting cases where the principles do not imply the SLP, thus challenging a common inference justification.

Contribution

The paper offers a new clarification and critique of Birnbaum's argument, demonstrating that WCP and SP do not necessarily imply the SLP, contrary to traditional claims.

Findings

Cases where data violate the SLP despite holding WCP and SP

Refutation of the claim that WCP and SP imply SLP

Clarification of the relationship between principles in statistical inference

Abstract

An essential component of inference based on familiar frequentist notions, such as $p$-values, significance and confidence levels, is the relevant sampling distribution. This feature results in violations of a principle known as the strong likelihood principle (SLP), the focus of this paper. In particular, if outcomes $\mathbf{x}^*$ and $\mathbf{y}^*$ from experiments $E_1$ and $E_2$ (both with unknown parameter $\theta$) have different probability models $f_1(\cdot),f_2(\cdot)$, then even though $f_1(\mathbf{x}^*;\theta)=cf_2(\mathbf{y}^*;\theta)$ for all $\theta$, outcomes $\mathbf{x}^*$ and $\mathbf{y}^*$ may have different implications for an inference about $\theta$. Although such violations stem from considering outcomes other than the one observed, we argue this does not require us to consider experiments other than the one performed to produce the data. David Cox [Ann. Math. Statist. 29 (1958) 357-372] proposes the Weak Conditionality Principle (WCP) to justify restricting the space of relevant repetitions. The WCP says that once it is known which $E_i$ produced the measurement, the assessment should be in terms of the properties of $E_i$. The surprising upshot of Allan Birnbaum's [J. Amer. Statist. Assoc. 57 (1962) 269-306] argument is that the SLP appears to follow from applying the WCP in the case of mixtures, and so uncontroversial a principle as sufficiency (SP). But this would preclude the use of sampling distributions. The goal of this article is to provide a new clarification and critique of Birnbaum's argument. Although his argument purports that [(WCP and SP) entails SLP], we show how data may violate the SLP while holding both the WCP and SP. Such cases also refute [WCP entails SLP].