Auto-weighted low-rank representation for clustering

TL;DR

This paper introduces ALRR, an unsupervised low-rank representation model that constructs a discriminative similarity graph for clustering by emphasizing salient features and preserving data geometry.

Contribution

The paper proposes a novel auto-weighted low-rank representation model that enhances similarity graph quality for clustering by feature selection and geometric preservation.

Findings

ALRR outperforms state-of-the-art methods by 1.8% to 10.8%.

ALRR effectively captures multi-subspace structures.

The method improves clustering accuracy on synthetic and real data.

Abstract

In this paper, a novel unsupervised low-rank representation model, i.e., Auto-weighted Low-Rank Representation (ALRR), is proposed to construct a more favorable similarity graph (SG) for clustering. In particular, ALRR enhances the discriminability of SG by capturing the multi-subspace structure and extracting the salient features simultaneously. Specifically, an auto-weighted penalty is introduced to learn a similarity graph by highlighting the effective features, and meanwhile, overshadowing the disturbed features. Consequently, ALRR obtains a similarity graph that can preserve the intrinsic geometrical structures within the data by enforcing a smaller similarity on two dissimilar samples. Moreover, we employ a block-diagonal regularizer to guarantee the learned graph contains $k$ diagonal blocks. This can facilitate a more discriminative representation learning for clustering tasks. Extensive experimental results on synthetic and real databases demonstrate the superiority of ALRR over other state-of-the-art methods with a margin of 1.8\%$\sim$10.8\%.