A Screening Strategy for Structured Optimization Involving Nonconvex $\ell_{q,p}$ Regularization
Tiange Li, Xiangyu Yang, Hao Wang

TL;DR
This paper introduces a screening rule strategy based on an IRL1 framework to efficiently identify inactive groups in structured nonconvex $\
Contribution
It presents a novel screening rule that preemptively removes inactive variables, enhancing computational efficiency in nonconvex $\
Findings
The screening rule can eliminate all inactive variables in finite IRL1 iterations.
Numerical experiments show significant speedups over existing algorithms.
The method effectively reduces problem size before solving.
Abstract
In this paper, we develop a simple yet effective screening rule strategy to improve the computational efficiency in solving structured optimization involving nonconvex regularization. Based on an iteratively reweighted (IRL1) framework, the proposed screening rule works like a preprocessing module that potentially removes the inactive groups before starting the subproblem solver, thereby reducing the computational time in total. This is mainly achieved by heuristically exploiting the dual subproblem information during each iteration.Moreover, we prove that our screening rule can remove all inactive variables in a finite number of iterations of the IRL1 method. Numerical experiments illustrate the efficiency of our screening rule strategy compared with several state-of-the-art algorithms.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Optimization Algorithms Research · Sparse and Compressive Sensing Techniques · Optimization and Variational Analysis
