Core-Set Selection for Data-efficient Land Cover Segmentation

TL;DR

This paper introduces core-set selection methods for remote sensing land cover segmentation, demonstrating that carefully chosen smaller data subsets can match or outperform full dataset training, thus enhancing data efficiency.

Contribution

The paper proposes six core-set selection approaches for remote sensing segmentation and benchmarks their effectiveness against traditional methods across multiple datasets and models.

Findings

Selected subsets can outperform full dataset training.

A 25% subset achieved higher performance than using all data.

Data-centric approaches significantly improve efficiency in remote sensing tasks.

Abstract

The increasing accessibility of remotely sensed data and their potential to support large-scale decision-making have driven the development of deep learning models for many Earth Observation tasks. Traditionally, such models rely on large datasets. However, the common assumption that larger training datasets lead to better performance tends to overlook issues related to data redundancy, noise, and the computational cost of processing massive datasets. Effective solutions must therefore consider not only the quantity but also the quality of data. Towards this, in this paper, we introduce six basic core-set selection approaches -- that rely on imagery only, labels only, or a combination of both -- and investigate whether they can identify high-quality subsets of data capable of maintaining -- or even surpassing -- the performance achieved when using full datasets for remote sensing semantic segmentation. We benchmark such approaches against two traditional baselines on three widely used land-cover classification datasets (DFC2022, Vaihingen, and Potsdam) using two different architectures (SegFormer and U-Net), thus establishing a general baseline for future works. Our experiments show that all proposed methods consistently outperform the baselines across multiple subset sizes, with some approaches even selecting core sets that surpass training on all available data. Notably, on DFC2022, a selected subset comprising only 25% of the training data yields slightly higher SegFormer performance than training with the entire dataset. This result shows the importance and potential of data-centric learning for the remote sensing domain. The code is available at https://github.com/keillernogueira/data-centric-rs-classification/.