Medical Image Classification with KAN-Integrated Transformers and Dilated Neighborhood Attention

TL;DR

MedViTV2 is a novel medical image classification model that integrates KAN layers and Dilated Neighborhood Attention to improve accuracy and efficiency, especially on corrupted data, outperforming previous methods across multiple datasets.

Contribution

Introduces MedViTV2, combining KAN and DiNA with hierarchical hybrid strategy for robust, efficient medical image classification, addressing real-world data corruption challenges.

Findings

Achieved state-of-the-art results on 27 out of 29 datasets.

Reduced computational complexity by 44%.

Improved accuracy by up to 13.4% on benchmarks.

Abstract

Convolutional networks, transformers, hybrid models, and Mamba-based architectures have demonstrated strong performance across various medical image classification tasks. However, these methods were primarily designed to classify clean images using labeled data. In contrast, real-world clinical data often involve image corruptions that are unique to multi-center studies and stem from variations in imaging equipment across manufacturers. In this paper, we introduce the Medical Vision Transformer (MedViTV2), a novel architecture incorporating Kolmogorov-Arnold Network (KAN) layers into the transformer architecture for the first time, aiming for generalized medical image classification. We have developed an efficient KAN block to reduce computational load while enhancing the accuracy of the original MedViT. Additionally, to counteract the fragility of our MedViT when scaled up, we propose an enhanced Dilated Neighborhood Attention (DiNA), an adaptation of the efficient fused dot-product attention kernel capable of capturing global context and expanding receptive fields to scale the model effectively and addressing feature collapse issues. Moreover, a hierarchical hybrid strategy is introduced to stack our Local Feature Perception and Global Feature Perception blocks in an efficient manner, which balances local and global feature perceptions to boost performance. Extensive experiments on 17 medical image classification datasets and 12 corrupted medical image datasets demonstrate that MedViTV2 achieved state-of-the-art results in 27 out of 29 experiments with reduced computational complexity. MedViTV2 is 44\% more computationally efficient than the previous version and significantly enhances accuracy, achieving improvements of 4.6\% on MedMNIST, 5.8\% on NonMNIST, and 13.4\% on the MedMNIST-C benchmark.