ClickAttention: Click Region Similarity Guided Interactive Segmentation

TL;DR

ClickAttention introduces a novel interactive segmentation method that expands positive click influence and reduces interference, achieving superior performance with fewer parameters and faster user interaction.

Contribution

The paper proposes a click attention mechanism and a discriminative affinity loss to improve segmentation accuracy and efficiency in interactive click-based segmentation.

Findings

Outperforms existing methods in accuracy and efficiency

Requires fewer clicks for accurate segmentation

Achieves state-of-the-art performance with fewer parameters

Abstract

Interactive segmentation algorithms based on click points have garnered significant attention from researchers in recent years. However, existing studies typically use sparse click maps as model inputs to segment specific target objects, which primarily affect local regions and have limited abilities to focus on the whole target object, leading to increased times of clicks. In addition, most existing algorithms can not balance well between high performance and efficiency. To address this issue, we propose a click attention algorithm that expands the influence range of positive clicks based on the similarity between positively-clicked regions and the whole input. We also propose a discriminative affinity loss to reduce the attention coupling between positive and negative click regions to avoid an accuracy decrease caused by mutual interference between positive and negative clicks. Extensive experiments demonstrate that our approach is superior to existing methods and achieves cutting-edge performance in fewer parameters. An interactive demo and all reproducible codes will be released at https://github.com/hahamyt/ClickAttention.