Localized Interactive Instance Segmentation

TL;DR

This paper introduces a localized clicking scheme for interactive instance segmentation that restricts user clicks near the target object and uses a novel transformation to improve localization, achieving state-of-the-art results.

Contribution

It proposes a new clicking scheme and a localization transformation that enhance efficiency and accuracy in interactive segmentation tasks.

Findings

Achieves state-of-the-art performance on standard benchmarks.

Improves segmentation accuracy with localized user interactions.

Demonstrates robustness of the localization strategy.

Abstract

In current interactive instance segmentation works, the user is granted a free hand when providing clicks to segment an object; clicks are allowed on background pixels and other object instances far from the target object. This form of interaction is highly inconsistent with the end goal of efficiently isolating objects of interest. In our work, we propose a clicking scheme wherein user interactions are restricted to the proximity of the object. In addition, we propose a novel transformation of the user-provided clicks to generate a weak localization prior on the object which is consistent with image structures such as edges, textures etc. We demonstrate the effectiveness of our proposed clicking scheme and localization strategy through detailed experimentation in which we raise state-of-the-art on several standard interactive segmentation benchmarks.