Towards Globally Predictable k-Space Interpolation: A White-box Transformer Approach

TL;DR

This paper introduces GPI-WT, a white-box Transformer model for k-space interpolation in MRI that leverages global structure and annihilation-based low-rank modeling, achieving high accuracy and interpretability.

Contribution

It proposes the first white-box Transformer framework for k-space interpolation, integrating structured low-rank modeling with learnable attention for MRI acceleration.

Findings

Outperforms state-of-the-art methods in interpolation accuracy

Provides superior interpretability of the interpolation process

Demonstrates effectiveness in accelerated MRI reconstruction

Abstract

Interpolating missing data in k-space is essential for accelerating imaging. However, existing methods, including convolutional neural network-based deep learning, primarily exploit local predictability while overlooking the inherent global dependencies in k-space. Recently, Transformers have demonstrated remarkable success in natural language processing and image analysis due to their ability to capture long-range dependencies. This inspires the use of Transformers for k-space interpolation to better exploit its global structure. However, their lack of interpretability raises concerns regarding the reliability of interpolated data. To address this limitation, we propose GPI-WT, a white-box Transformer framework based on Globally Predictable Interpolation (GPI) for k-space. Specifically, we formulate GPI from the perspective of annihilation as a novel k-space structured low-rank (SLR) model. The global annihilation filters in the SLR model are treated as learnable parameters, and the subgradients of the SLR model naturally induce a learnable attention mechanism. By unfolding the subgradient-based optimization algorithm of SLR into a cascaded network, we construct the first white-box Transformer specifically designed for accelerated MRI. Experimental results demonstrate that the proposed method significantly outperforms state-of-the-art approaches in k-space interpolation accuracy while providing superior interpretability.