Careful Seeding for k-Medois Clustering with Incremental k-Means++ Initialization

TL;DR

This paper introduces a novel incremental k-medoids clustering algorithm, INCKPP, which improves initialization, handles imbalanced datasets better, and is further optimized for efficiency with INCKPPsample, outperforming existing methods.

Contribution

The paper proposes the INCKPP algorithm with incremental k-means++ initialization, overcoming hyperparameter issues and improving clustering on imbalanced datasets, along with an efficient INCKPPsample variant.

Findings

INCKPP outperforms existing algorithms on synthetic and real datasets.

The incremental initialization improves clustering accuracy and robustness.

INCKPPsample enhances efficiency without sacrificing performance.

Abstract

K-medoids clustering is a popular variant of k-means clustering and widely used in pattern recognition and machine learning. A main drawback of k-medoids clustering is that an improper initialization can cause it to get trapped in local optima. An improved k-medoids clustering algorithm, called INCKM algorithm, which is the first to apply incremental initialization to k-medoids clustering, was recently proposed to overcome this drawback. The INCKM algorithm requires the construction of a subset of candidate medoids determined by one hyperparameter for initialization, and meanwhile, it always fails when dealing with imbalanced datasets with an incorrect hyperparameter selection. In this paper, we propose a novel k-medoids clustering algorithm, called incremental k-means++ (INCKPP) algorithm, which initializes with a novel incremental manner, attempting to optimally add one new cluster center at each stage through a nonparametric and stochastic k-means++ initialization. The INCKPP algorithm overcomes the difficulty of hyperparameter selection in the INCKM algorithm, improves the clustering performance, and can deal with imbalanced datasets well. However, the INCKPP algorithm is not computationally efficient enough. To deal with this, we further propose an improved INCKPP algorithm, called INCKPPsample algorithm, which improves the clustering efficiency while maintaining the clustering performance of the INCKPP algorithm. Extensive results from experiments on both synthetic and real-world datasets, including imbalanced datasets, illustrate that the proposed algorithms outperforms than the other compared algorithms.