Med-URWKV: Pure RWKV With ImageNet Pre-training For Medical Image Segmentation

TL;DR

This paper introduces Med-URWKV, a pure RWKV-based medical image segmentation model that leverages ImageNet pretraining, demonstrating improved performance over models trained from scratch and highlighting the benefits of pretraining in this domain.

Contribution

We propose Med-URWKV, the first pure RWKV segmentation model in medical imaging that utilizes ImageNet pretraining to enhance segmentation accuracy.

Findings

Achieves comparable or superior performance to models trained from scratch.

Validates the effectiveness of pretraining VRWKV encoders for medical segmentation.

Demonstrates strong long-range modeling with linear complexity.

Abstract

Medical image segmentation is a fundamental and key technology in computer-aided diagnosis and treatment. Previous methods can be broadly classified into three categories: convolutional neural network (CNN) based, Transformer based, and hybrid architectures that combine both. However, each of them has its own limitations, such as restricted receptive fields in CNNs or the computational overhead caused by the quadratic complexity of Transformers. Recently, the Receptance Weighted Key Value (RWKV) model has emerged as a promising alternative for various vision tasks, offering strong long-range modeling capabilities with linear computational complexity. Some studies have also adapted RWKV to medical image segmentation tasks, achieving competitive performance. However, most of these studies focus on modifications to the Vision-RWKV (VRWKV) mechanism and train models from scratch, without exploring the potential advantages of leveraging pre-trained VRWKV models for medical image segmentation tasks. In this paper, we propose Med-URWKV, a pure RWKV-based architecture built upon the U-Net framework, which incorporates ImageNet-based pretraining to further explore the potential of RWKV in medical image segmentation tasks. To the best of our knowledge, Med-URWKV is the first pure RWKV segmentation model in the medical field that can directly reuse a large-scale pre-trained VRWKV encoder. Experimental results on seven datasets demonstrate that Med-URWKV achieves comparable or even superior segmentation performance compared to other carefully optimized RWKV models trained from scratch. This validates the effectiveness of using a pretrained VRWKV encoder in enhancing model performance. The codes will be released.