MV-Adapter: Enhancing Underwater Instance Segmentation via Adaptive Channel Attention

TL;DR

This paper introduces the MV-Adapter, an adaptive channel attention module that enhances underwater instance segmentation by dynamically adjusting feature importance, leading to improved performance in challenging underwater environments.

Contribution

The paper proposes the MV-Adapter module that effectively adapts feature weights across channels, improving segmentation accuracy in complex underwater scenes.

Findings

Improved mAP, AP50, and AP75 metrics on USIS10K dataset.

Enhanced segmentation performance in challenging underwater conditions.

Abstract

Underwater instance segmentation is a fundamental and critical step in various underwater vision tasks. However, the decline in image quality caused by complex underwater environments presents significant challenges to existing segmentation models. While the state-of-the-art USIS-SAM model has demonstrated impressive performance, it struggles to effectively adapt to feature variations across different channels in addressing issues such as light attenuation, color distortion, and complex backgrounds. This limitation hampers its segmentation performance in challenging underwater scenarios. To address these issues, we propose the MarineVision Adapter (MV-Adapter). This module introduces an adaptive channel attention mechanism that enables the model to dynamically adjust the feature weights of each channel based on the characteristics of underwater images. By adaptively weighting features, the model can effectively handle challenges such as light attenuation, color shifts, and complex backgrounds. Experimental results show that integrating the MV-Adapter module into the USIS-SAM network architecture further improves the model's overall performance, especially in high-precision segmentation tasks. On the USIS10K dataset, the module achieves improvements in key metrics such as mAP, AP50, and AP75 compared to competitive baseline models.