HiFiSeg: High-Frequency Information Enhanced Polyp Segmentation with Global-Local Vision Transformer

TL;DR

HiFiSeg is a novel vision transformer-based network that enhances high-frequency feature processing to improve colon polyp segmentation accuracy, especially for small targets and boundary details.

Contribution

It introduces a global-local interaction module and a selective aggregation module within a pyramid vision transformer framework for better high-frequency information capture.

Findings

Achieved state-of-the-art mDice scores of 0.826 and 0.822 on CVC-ColonDB and ETIS datasets.

Effectively captures boundary details and small targets in polyp segmentation.

Outperforms existing methods in complex scenarios.

Abstract

Numerous studies have demonstrated the strong performance of Vision Transformer (ViT)-based methods across various computer vision tasks. However, ViT models often struggle to effectively capture high-frequency components in images, which are crucial for detecting small targets and preserving edge details, especially in complex scenarios. This limitation is particularly challenging in colon polyp segmentation, where polyps exhibit significant variability in structure, texture, and shape. High-frequency information, such as boundary details, is essential for achieving precise semantic segmentation in this context. To address these challenges, we propose HiFiSeg, a novel network for colon polyp segmentation that enhances high-frequency information processing through a global-local vision transformer framework. HiFiSeg leverages the pyramid vision transformer (PVT) as its encoder and introduces two key modules: the global-local interaction module (GLIM) and the selective aggregation module (SAM). GLIM employs a parallel structure to fuse global and local information at multiple scales, effectively capturing fine-grained features. SAM selectively integrates boundary details from low-level features with semantic information from high-level features, significantly improving the model's ability to accurately detect and segment polyps. Extensive experiments on five widely recognized benchmark datasets demonstrate the effectiveness of HiFiSeg for polyp segmentation. Notably, the mDice scores on the challenging CVC-ColonDB and ETIS datasets reached 0.826 and 0.822, respectively, underscoring the superior performance of HiFiSeg in handling the specific complexities of this task.