Non-PSD Matrix Sketching with Applications to Regression and Optimization
Zhili Feng, Fred Roosta, David P. Woodruff

TL;DR
This paper introduces new matrix sketching methods for non-PSD matrices, including those with complex entries, enabling efficient computations in regression and optimization tasks.
Contribution
The paper develops novel dimensionality reduction techniques for non-PSD and complex matrices, expanding the applicability of matrix sketching beyond PSD matrices.
Findings
Effective sketching methods for non-PSD matrices demonstrated
Applications to convex and non-convex optimization shown
Techniques enable efficient $\,\ell_p$-regression and vector-matrix-vector queries
Abstract
A variety of dimensionality reduction techniques have been applied for computations involving large matrices. The underlying matrix is randomly compressed into a smaller one, while approximately retaining many of its original properties. As a result, much of the expensive computation can be performed on the small matrix. The sketching of positive semidefinite (PSD) matrices is well understood, but there are many applications where the related matrices are not PSD, including Hessian matrices in non-convex optimization and covariance matrices in regression applications involving complex numbers. In this paper, we present novel dimensionality reduction methods for non-PSD matrices, as well as their ``square-roots", which involve matrices with complex entries. We show how these techniques can be used for multiple downstream tasks. In particular, we show how to use the proposed matrix…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSparse and Compressive Sensing Techniques · Stochastic Gradient Optimization Techniques · Advanced Optimization Algorithms Research
