Heavy Tailed Horseshoe Priors

TL;DR

This paper introduces a Heavy-tailed Horseshoe prior that enhances local-global shrinkage models by providing sharper sparsity at the origin and heavier tails, leading to improved reconstruction accuracy.

Contribution

The paper proposes a novel Heavy-tailed Horseshoe prior with better spike and slab behavior through mixing on shape parameters, improving Bayesian sparse estimation.

Findings

Improved spike and slab behavior with the new prior.

Better reconstruction of mean structures in simulations.

Enhanced absolute error performance compared to existing variants.

Abstract

Locally adaptive shrinkage in the Bayesian framework is achieved through the use of local-global prior distributions that model both the global level of sparsity as well as individual shrinkage parameters for mean structure parameters. The most popular of these models is the Horseshoe prior and its variants due to their spike and slab behavior involving an asymptote at the origin and heavy tails. In this article, we present an alternative Horseshoe prior that exhibits both a sharper asymptote at the origin as well as heavier tails, which we call the Heavy-tailed Horseshoe prior. We prove that mixing on the shape parameters provides improved spike and slab behavior as well as better reconstruction properties than other Horseshoe variants. A simulation study is provided to show the advantage of the heavy-tailed Horseshoe in terms of absolute error to both the truth mean structure as well as the oracle.