Hierarchy of Groups Evaluation Using Different F-score Variants

TL;DR

This paper investigates the evaluation of hierarchical clustering quality using three variants of the F-score, introducing a novel partial order index and analyzing their properties through experiments.

Contribution

It introduces a new partial order variant of the F-score for hierarchical clustering evaluation and compares it with classic and hierarchical variants.

Findings

The partial order F-score provides unique insights into hierarchy quality.

Different F-score variants have distinct strengths and weaknesses.

Experimental results highlight the suitability of each measure for specific scenarios.

Abstract

The paper presents a cursory examination of clustering, focusing on a rarely explored field of hierarchy of clusters. Based on this, a short discussion of clustering quality measures is presented and the F-score measure is examined more deeply. As there are no attempts to assess the quality for hierarchies of clusters, three variants of the F-Score based index are presented: classic, hierarchical and partial order. The partial order index is the authors' approach to the subject. Conducted experiments show the properties of the considered measures. In conclusions, the strong and weak sides of each variant are presented.