Testing Sparsity-Inducing Penalties
Maryclare Griffin, Peter D. Hoff

TL;DR
This paper develops a statistical test to determine if a Laplace prior is suitable for penalized regression, and introduces an adaptive method to select more appropriate priors, improving estimation accuracy.
Contribution
It proposes a testing procedure for Laplace prior suitability and an adaptive approach to select better priors, enhancing penalized regression estimation.
Findings
Test achieves desired significance level and detects violations effectively.
Adaptive procedure improves estimation under various prior distributions.
Method performs well with large sample sizes and many coefficients.
Abstract
Many penalized maximum likelihood estimators correspond to posterior mode estimators under specific prior distributions. Appropriateness of a particular class of penalty functions can therefore be interpreted as the appropriateness of a prior for the parameters. For example, the appropriateness of a lasso penalty for regression coefficients depends on the extent to which the empirical distribution of the regression coefficients resembles a Laplace distribution. We give a testing procedure of whether or not a Laplace prior is appropriate and accordingly, whether or not using a lasso penalized estimate is appropriate. This testing procedure is designed to have power against exponential power priors which correspond to penalties. Via simulations, we show that this testing procedure achieves the desired level and has enough power to detect violations of the Laplace assumption when…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical Methods and Inference · Fault Detection and Control Systems · Target Tracking and Data Fusion in Sensor Networks
