A Sparse Graph Formulation for Efficient Spectral Image Segmentation

TL;DR

This paper introduces a scalable spectral image segmentation method using a sparse graph with extra nodes for color data, outperforming traditional algorithms in accuracy and efficiency.

Contribution

It proposes a novel sparse graph formulation with extra nodes for spectral segmentation, improving scalability and interpretability over existing methods.

Findings

Outperforms traditional spectral and modern unsupervised segmentation algorithms.

Scalable and interpretable spectral segmentation approach.

Effective on both real and synthetic datasets.

Abstract

Spectral Clustering is one of the most traditional methods to solve segmentation problems. Based on Normalized Cuts, it aims at partitioning an image using an objective function defined by a graph. Despite their mathematical attractiveness, spectral approaches are traditionally neglected by the scientific community due to their practical issues and underperformance. In this paper, we adopt a sparse graph formulation based on the inclusion of extra nodes to a simple grid graph. While the grid encodes the pixel spatial disposition, the extra nodes account for the pixel color data. Applying the original Normalized Cuts algorithm to this graph leads to a simple and scalable method for spectral image segmentation, with an interpretable solution. Our experiments also demonstrate that our proposed methodology over performs both traditional and modern unsupervised algorithms for segmentation in both real and synthetic data.