On the Hierarchical Bayes justification of Empirical Bayes Confidence Intervals

TL;DR

This paper establishes a theoretical link between empirical Bayes and hierarchical Bayes methods for interval estimation in multi-level normal models, showing that with a suitable prior, empirical Bayes intervals can be interpreted as credible intervals with near-nominal coverage.

Contribution

It introduces a novel framework that uses matching priors to reconcile empirical Bayes confidence intervals with hierarchical Bayes credible intervals in two-level models.

Findings

Empirical Bayes intervals with $O(m^{-3/2})$ coverage error can be viewed as credible intervals.

A specific area-dependent matching prior on the variance component achieves proper posterior inference.

Theoretical results are supported by simulations and real data analysis.

Abstract

Multi-level normal hierarchical models, also interpreted as mixed effects models, play an important role in developing statistical theory in multi-parameter estimation for a wide range of applications. In this article, we propose a novel reconciliation framework of the empirical Bayes (EB) and hierarchical Bayes approaches for interval estimation of random effects under a two-level normal model. Our framework shows that a second-order efficient empirical Bayes confidence interval, with EB coverage error of order $O(m^{-3/2})$, $m$ being the number of areas in the area-level model, can also be viewed as a credible interval whose posterior coverage is close to the nominal level, provided a carefully chosen prior - referred to as a 'matching prior' - is placed on the hyperparameters. While existing literature has examined matching priors that reconcile frequentist and Bayesian inference in various settings, this paper is the first to study matching priors with the goal of interval estimation of random effects in a two-level model. We obtain an area-dependent matching prior on the variance component that achieves a proper posterior under mild regularity conditions. The theoretical results in the paper are corroborated through a Monte Carlo simulation study and a real data analysis.