COMPrompter: reconceptualized segment anything model with multiprompt network for camouflaged object detection

TL;DR

COMPrompter enhances the Segment Anything Model with multiprompt strategies, including boundary and box prompts, and high-frequency feature extraction, significantly improving camouflaged object detection performance.

Contribution

The paper introduces a novel multiprompt network for SAM that incorporates boundary and box prompts, along with high-frequency features, to advance camouflaged object detection.

Findings

Achieves state-of-the-art performance on COD benchmarks.

Surpasses leading models by 2.2% in COD10K.

Demonstrates superior results in polyp segmentation.

Abstract

We rethink the segment anything model (SAM) and propose a novel multiprompt network called COMPrompter for camouflaged object detection (COD). SAM has zero-shot generalization ability beyond other models and can provide an ideal framework for COD. Our network aims to enhance the single prompt strategy in SAM to a multiprompt strategy. To achieve this, we propose an edge gradient extraction module, which generates a mask containing gradient information regarding the boundaries of camouflaged objects. This gradient mask is then used as a novel boundary prompt, enhancing the segmentation process. Thereafter, we design a box-boundary mutual guidance module, which fosters more precise and comprehensive feature extraction via mutual guidance between a boundary prompt and a box prompt. This collaboration enhances the model's ability to accurately detect camouflaged objects. Moreover, we employ the discrete wavelet transform to extract high-frequency features from image embeddings. The high-frequency features serve as a supplementary component to the multiprompt system. Finally, our COMPrompter guides the network to achieve enhanced segmentation results, thereby advancing the development of SAM in terms of COD. Experimental results across COD benchmarks demonstrate that COMPrompter achieves a cutting-edge performance, surpassing the current leading model by an average positive metric of 2.2% in COD10K. In the specific application of COD, the experimental results in polyp segmentation show that our model is superior to top-tier methods as well. The code will be made available at https://github.com/guobaoxiao/COMPrompter.