Split Bregman Isotropic and Anisotropic Image Deblurring with Kronecker Product Sum Approximations using Single Precision Enlarged-GKB or RSVD Algorithms to provide low rank truncated SVDs

TL;DR

This paper introduces a novel approach for large-scale image deblurring that uses single precision Kronecker product approximations via an enlarged Golub Kahan Bidiagonalization algorithm, improving efficiency and scalability.

Contribution

It proposes an enlarged Golub Kahan Bidiagonalization method for efficient low-rank SVD approximation in image deblurring, outperforming randomized SVD in certain scenarios.

Findings

Single precision Kronecker approximations are effective for large-scale problems.

Enlarged Golub Kahan Bidiagonalization competes well with randomized SVD.

Major computational costs are in approximation, not regularization.

Abstract

We consider the solution of the $\ell_1$ regularized image deblurring problem using isotropic and anisotropic regularization implemented with the split Bregman algorithm. For large scale problems, we replace the system matrix $A$ using a Kronecker product approximation obtained via an approximate truncated singular value decomposition for the reordered matrix $\mathcal{R}(A)$. To obtain the approximate decomposition for $\mathcal{R}(A)$ we propose the enlarged Golub Kahan Bidiagonalization algorithm that proceeds by enlarging the Krylov subspace beyond either a given rank for the desired approximation, or uses an automatic stopping test that provides a suitable rank for the approximation. The resultant expansion is contrasted with the use of the truncated and the randomized singular value decompositions with the same number of terms. To further extend the scale of problem that can be considered we implement the determination of the approximation using single precision, while performing all steps for the regularization in standard double precision. The reported numerical tests demonstrate the effectiveness of applying the approximate single precision Kronecker product expansion for $A$, combined with either isotropic or anisotropic regularization implemented using the split Bregman algorithm, for the solution of image deblurring problems. As the size of the problem increases, our results demonstrate that the major costs are associated with determining the Kronecker product approximation, rather than with the cost of the regularization algorithm. Moreover, the enlarged Golub Kahan Bidiagonalization algorithm competes favorably with the randomized singular value decomposition for estimating the approximate singular value decomposition.