Trainable ISTA for Sparse Signal Recovery

TL;DR

TISTA is a trainable sparse signal recovery algorithm that combines iterative estimation with deep learning techniques, offering faster convergence and stability across various sensing matrices.

Contribution

It introduces a novel trainable ISTA algorithm with fewer trainable variables, enabling efficient and stable sparse signal recovery with improved convergence speed.

Findings

TISTA outperforms AMP and LISTA in convergence speed.

It is effective with diverse sensing matrices.

The training process is highly stable and fast.

Abstract

In this paper, we propose a novel sparse signal recovery algorithm called Trainable ISTA (TISTA). The proposed algorithm consists of two estimation units such as a linear estimation unit and a minimum mean squared error (MMSE) estimator-based shrinkage unit. The estimated error variance required in the MMSE shrinkage unit is precisely estimated from a tentative estimate of the original signal. The remarkable feature of the proposed scheme is that TISTA includes adjustable variables controlling a step size and the error variance for the MMSE shrinkage. The variables are adjusted by standard deep learning techniques. The number of trainable variables of TISTA is equal to the number of iteration rounds and it is much smaller than that of known learnable sparse signal recovery algorithms. This feature leads to highly stable and fast training processes of TISTA. Computer experiments show that TISTA is applicable to various classes of sensing matrices such as Gaussian matrices, binary matrices and matrices with large condition numbers. Numerical results also demonstrate that TISTA shows significantly faster convergence than those of AMP and LISTA in many cases.