Image to Pseudo-Episode: Boosting Few-Shot Segmentation by Unlabeled Data

TL;DR

This paper introduces a novel approach called Image to Pseudo-Episode (IPE) that leverages unlabeled data through spectral clustering and data augmentation to significantly improve few-shot segmentation performance.

Contribution

The paper proposes a new method to generate pseudo-episodes from unlabeled data, enhancing generalization in few-shot segmentation tasks.

Findings

Achieves state-of-the-art results on PASCAL-5^i and COCO-20^i datasets.

Effectively utilizes unlabeled data to boost segmentation accuracy.

Demonstrates the effectiveness of spectral clustering in pseudo-label generation.

Abstract

Few-shot segmentation (FSS) aims to train a model which can segment the object from novel classes with a few labeled samples. The insufficient generalization ability of models leads to unsatisfactory performance when the models lack enough labeled data from the novel classes. Considering that there are abundant unlabeled data available, it is promising to improve the generalization ability by exploiting these various data. For leveraging unlabeled data, we propose a novel method, named Image to Pseudo-Episode (IPE), to generate pseudo-episodes from unlabeled data. Specifically, our method contains two modules, i.e., the pseudo-label generation module and the episode generation module. The former module generates pseudo-labels from unlabeled images by the spectral clustering algorithm, and the latter module generates pseudo-episodes from pseudo-labeled images by data augmentation methods. Extensive experiments on PASCAL-$5^i$ and COCO-$20^i$ demonstrate that our method achieves the state-of-the-art performance for FSS.