TL;DR
This paper introduces safe squeezing, a method to accelerate antisparse coding by detecting and compacting saturated entries, leading to reduced problem dimensionality and faster computation.
Contribution
The paper presents a novel safe squeezing technique that identifies saturated entries in antisparse coding, enabling dimensionality reduction and computational speedups.
Findings
Effective detection of saturated entries in antisparse solutions
Significant computational gains demonstrated in experiments
Method applicable to large-scale antisparse problems
Abstract
Spreading the information over all coefficients of a representation is a desirable property in many applications such as digital communication or machine learning. This so-called antisparse representation can be obtained by solving a convex program involving an -norm penalty combined with a quadratic discrepancy. In this paper, we propose a new methodology, dubbed safe squeezing, to accelerate the computation of antisparse representation. We describe a test that allows to detect saturated entries in the solution of the optimization problem. The contribution of these entries is compacted into a single vector, thus operating a form of dimensionality reduction. We propose two algorithms to solve the resulting lower dimensional problem. Numerical experiments show the effectiveness of the proposed method to detect the saturated components of the solution and illustrates the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
MethodsTest
