
TL;DR
This paper presents a flexible method for aggregating least squares estimators to produce models that are both sparse and follow known structural patterns, improving estimation accuracy in complex settings.
Contribution
It introduces a general framework for structured sparse aggregation that accommodates various structures and penalties, with theoretical guarantees and empirical validation.
Findings
Estimator satisfies structured sparse oracle inequalities.
Performs at least as well as standard sparse aggregation.
Empirical results demonstrate effectiveness in simulations and HIV data.
Abstract
We introduce a method for aggregating many least squares estimator so that the resulting estimate has two properties: sparsity and structure. That is, only a few candidate covariates are used in the resulting model, and the selected covariates follow some structure over the candidate covariates that is assumed to be known a priori. While sparsity is well studied in many settings, including aggregation, structured sparse methods are still emerging. We demonstrate a general framework for structured sparse aggregation that allows for a wide variety of structures, including overlapping grouped structures and general structural penalties defined as set functions on the set of covariates. We show that such estimators satisfy structured sparse oracle inequalities --- their finite sample risk adapts to the structured sparsity of the target. These inequalities reveal that under suitable…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Statistical Methods and Models · Statistical Methods and Inference · Statistical Methods and Bayesian Inference
