A Pixel-Level Meta-Learner for Weakly Supervised Few-Shot Semantic Segmentation

TL;DR

This paper introduces a pixel-level meta-learner for weakly supervised few-shot semantic segmentation, which predicts pseudo masks from limited data and semantic labels, improving performance in challenging weak supervision scenarios.

Contribution

The paper proposes a novel meta-learning framework that predicts pseudo pixel-level masks from limited data and exploits this information for improved weakly supervised segmentation.

Findings

Achieves competitive results under fully supervised settings.

Outperforms state-of-the-art methods in weakly supervised scenarios.

Demonstrates effectiveness across benchmark datasets.

Abstract

Few-shot semantic segmentation addresses the learning task in which only few images with ground truth pixel-level labels are available for the novel classes of interest. One is typically required to collect a large mount of data (i.e., base classes) with such ground truth information, followed by meta-learning strategies to address the above learning task. When only image-level semantic labels can be observed during both training and testing, it is considered as an even more challenging task of weakly supervised few-shot semantic segmentation. To address this problem, we propose a novel meta-learning framework, which predicts pseudo pixel-level segmentation masks from a limited amount of data and their semantic labels. More importantly, our learning scheme further exploits the produced pixel-level information for query image inputs with segmentation guarantees. Thus, our proposed learning model can be viewed as a pixel-level meta-learner. Through extensive experiments on benchmark datasets, we show that our model achieves satisfactory performances under fully supervised settings, yet performs favorably against state-of-the-art methods under weakly supervised settings.