IAFI-FCOS: Intra- and across-layer feature interaction FCOS model for lesion detection of CT images

TL;DR

This paper introduces IAFI-FCOS, a novel lesion detection model for CT images that enhances feature interaction within and across layers, improving detection of small and ambiguous lesions by utilizing multi-scale feature fusion and attention mechanisms.

Contribution

The paper proposes a new intra- and across-layer feature interaction FCOS model with a multi-scale fusion mechanism, incorporating attention blocks to improve lesion detection in medical images.

Findings

Achieves state-of-the-art results on pancreatic lesion dataset

Effectively detects small and boundary-ambiguous lesions

Enhances feature representation through intra- and across-layer interactions

Abstract

Effective lesion detection in medical image is not only rely on the features of lesion region,but also deeply relative to the surrounding information.However,most current methods have not fully utilize it.What is more,multi-scale feature fusion mechanism of most traditional detectors are unable to transmit detail information without loss,which makes it hard to detect small and boundary ambiguous lesion in early stage disease.To address the above issues,we propose a novel intra- and across-layer feature interaction FCOS model (IAFI-FCOS) with a multi-scale feature fusion mechanism ICAF-FPN,which is a network structure with intra-layer context augmentation (ICA) block and across-layer feature weighting (AFW) block.Therefore,the traditional FCOS detector is optimized by enriching the feature representation from two perspectives.Specifically,the ICA block utilizes dilated attention to augment the context information in order to capture long-range dependencies between the lesion region and the surrounding.The AFW block utilizes dual-axis attention mechanism and weighting operation to obtain the efficient across-layer interaction features,enhancing the representation of detailed features.Our approach has been extensively experimented on both the private pancreatic lesion dataset and the public DeepLesion dataset,our model achieves SOTA results on the pancreatic lesion dataset.