Heavy Tailed Horseshoe Priors
Andrew Womack, Zikun Yang

TL;DR
This paper introduces a Heavy-tailed Horseshoe prior that enhances local-global shrinkage models by providing sharper sparsity at the origin and heavier tails, leading to improved reconstruction accuracy.
Contribution
The paper proposes a novel Heavy-tailed Horseshoe prior with better spike and slab behavior through mixing on shape parameters, improving Bayesian sparse estimation.
Findings
Improved spike and slab behavior with the new prior.
Better reconstruction of mean structures in simulations.
Enhanced absolute error performance compared to existing variants.
Abstract
Locally adaptive shrinkage in the Bayesian framework is achieved through the use of local-global prior distributions that model both the global level of sparsity as well as individual shrinkage parameters for mean structure parameters. The most popular of these models is the Horseshoe prior and its variants due to their spike and slab behavior involving an asymptote at the origin and heavy tails. In this article, we present an alternative Horseshoe prior that exhibits both a sharper asymptote at the origin as well as heavier tails, which we call the Heavy-tailed Horseshoe prior. We prove that mixing on the shape parameters provides improved spike and slab behavior as well as better reconstruction properties than other Horseshoe variants. A simulation study is provided to show the advantage of the heavy-tailed Horseshoe in terms of absolute error to both the truth mean structure as well…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBayesian Methods and Mixture Models · Statistical Methods and Inference · Statistical Methods and Bayesian Inference
