A microstructure estimation Transformer inspired by sparse representation for diffusion MRI
Tianshu Zheng, Cong Sun, Weihao Zheng, Wen Shi, Haotian Li, Yi Sun, Yi, Zhang, Guangbin Wang, Chuyang Ye, Dan Wu

TL;DR
This paper introduces METSC, a Transformer-based framework with sparse coding for efficient microstructure estimation in diffusion MRI, reducing scan time and outperforming existing methods.
Contribution
The paper presents a novel Transformer-inspired model incorporating sparse coding to improve microstructure estimation from sparse q-space data in diffusion MRI.
Findings
Achieved up to 11.25-fold acceleration in scan time.
Outperformed state-of-the-art learning-based methods.
Validated on IVIM and NODDI models.
Abstract
Diffusion magnetic resonance imaging (dMRI) is an important tool in characterizing tissue microstructure based on biophysical models, which are complex and highly non-linear. Resolving microstructures with optimization techniques is prone to estimation errors and requires dense sampling in the q-space. Deep learning based approaches have been proposed to overcome these limitations. Motivated by the superior performance of the Transformer, in this work, we present a learning-based framework based on Transformer, namely, a Microstructure Estimation Transformer with Sparse Coding (METSC) for dMRI-based microstructure estimation with downsampled q-space data. To take advantage of the Transformer while addressing its limitation in large training data requirements, we explicitly introduce an inductive bias - model bias into the Transformer using a sparse coding technique to facilitate the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Neuroimaging Techniques and Applications · Advanced MRI Techniques and Applications · MRI in cancer diagnosis
MethodsAttention Is All You Need · Linear Layer · Adam · Byte Pair Encoding · Absolute Position Encodings · Residual Connection · Label Smoothing · Position-Wise Feed-Forward Layer · Dense Connections · Dropout
