Localized Interactive Instance Segmentation
Soumajit Majumder, Angela Yao

TL;DR
This paper introduces a localized clicking scheme for interactive instance segmentation that restricts user clicks near the target object and uses a novel transformation to improve localization, achieving state-of-the-art results.
Contribution
It proposes a new clicking scheme and a localization transformation that enhance efficiency and accuracy in interactive segmentation tasks.
Findings
Achieves state-of-the-art performance on standard benchmarks.
Improves segmentation accuracy with localized user interactions.
Demonstrates robustness of the localization strategy.
Abstract
In current interactive instance segmentation works, the user is granted a free hand when providing clicks to segment an object; clicks are allowed on background pixels and other object instances far from the target object. This form of interaction is highly inconsistent with the end goal of efficiently isolating objects of interest. In our work, we propose a clicking scheme wherein user interactions are restricted to the proximity of the object. In addition, we propose a novel transformation of the user-provided clicks to generate a weak localization prior on the object which is consistent with image structures such as edges, textures etc. We demonstrate the effectiveness of our proposed clicking scheme and localization strategy through detailed experimentation in which we raise state-of-the-art on several standard interactive segmentation benchmarks.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Image and Video Retrieval Techniques · Visual Attention and Saliency Detection · Multimodal Machine Learning Applications
