# GlomSAM: Hybrid customized SAM for multi-glomerular detection and segmentation in immunofluorescence images

## TL;DR

GlomSAM is a new model for accurately detecting and segmenting kidney glomeruli in immunofluorescence images, improving diagnostic efficiency.

## Contribution

GlomSAM introduces a hybrid SAM model with a fusion encoder and rough mask generator for better glomerular segmentation in pathology.

## Key findings

- GlomSAM outperforms existing methods in multi-glomerular segmentation accuracy and recall.
- The fusion encoder strategy enhances SAM's adaptability to immunofluorescence pathology tasks.
- A rough mask generator improves automated prompting and final segmentation results.

## Abstract

In nephrology research, multi-glomerular segmentation in immunofluorescence images plays a crucial role in the early detection and diagnosis of chronic kidney disease. However, obtaining accurate segmentations often requires labor-intensive annotations and existing methods are hampered by low recall rates and limited accuracy. Recently, a general Segment Anything Model (SAM) has demonstrated promising performance in several segmentation tasks. In this paper, a SAM-based multi-glomerular segmentation model (GlomSAM) is introduced to employ SAM in the immunofluorescence pathology domain. The fusion encoder strategy utilizing the advantages of both convolution networks and transformer structures with prompts is conducted to facilitate SAM’s transfer learning in applications of pathological analysis. Moreover, a rough mask generator is employed to generate preliminary glomerular segmentation masks, enabling automated input prompting and improving the final segmentation results. Extensive comparative experiments and ablation studies show its state-of-the-art performance surpassing other relevant research. We hope this report will provide insights to advance the field of glomerular segmentation and promote more interesting work in the future.