Low-rank matrix recovery via iteratively reweighted least squares minimization

TL;DR

This paper introduces an efficient iterative reweighted least squares algorithm for low-rank matrix recovery from limited measurements, combining nuclear norm minimization and low-rank promotion, with theoretical guarantees and practical efficiency.

Contribution

It proposes a novel algorithm that guarantees accurate low-rank matrix recovery under generalized Null Space Property conditions, with improved computational efficiency using the Woodbury identity.

Findings

Algorithm successfully recovers low-rank matrices in experiments.

Demonstrates robustness in matrix completion tasks.

Shows competitiveness with recent state-of-the-art methods.

Abstract

We present and analyze an efficient implementation of an iteratively reweighted least squares algorithm for recovering a matrix from a small number of linear measurements. The algorithm is designed for the simultaneous promotion of both a minimal nuclear norm and an approximatively low-rank solution. Under the assumption that the linear measurements fulfill a suitable generalization of the Null Space Property known in the context of compressed sensing, the algorithm is guaranteed to recover iteratively any matrix with an error of the order of the best k-rank approximation. In certain relevant cases, for instance for the matrix completion problem, our version of this algorithm can take advantage of the Woodbury matrix identity, which allows to expedite the solution of the least squares problems required at each iteration. We present numerical experiments that confirm the robustness of the algorithm for the solution of matrix completion problems, and demonstrate its competitiveness with respect to other techniques proposed recently in the literature.