# Clubmark: a Parallel Isolation Framework for Benchmarking and Profiling Clustering Algorithms on NUMA Architectures

## TL;DR

Clubmark is an open-source, parallel benchmarking framework designed for evaluating diverse clustering algorithms on NUMA architectures, enabling detailed performance analysis and comparison across various datasets and clustering techniques.

## Contribution

It introduces a comprehensive, extensible benchmarking platform that supports parallel execution, fine-grained control, and evaluation of multiple clustering algorithms on NUMA systems.

## Key findings

- Supports a wide range of clustering algorithms.
- Enables detailed performance profiling and evaluation.
- Provides a systematic, open-source benchmarking environment.

## Abstract

There is a great diversity of clustering and community detection algorithms, which are key components of many data analysis and exploration systems. To the best of our knowledge, however, there does not exist yet any uniform benchmarking framework, which is publicly available and suitable for the parallel benchmarking of diverse clustering algorithms on a wide range of synthetic and real-world datasets. In this paper, we introduce Clubmark, a new extensible framework that aims to fill this gap by providing a parallel isolation benchmarking platform for clustering algorithms and their evaluation on NUMA servers. Clubmark allows for fine-grained control over various execution variables (timeouts, memory consumption, CPU affinity and cache policy) and supports the evaluation of a wide range of clustering algorithms including multi-level, hierarchical and overlapping clustering techniques on both weighted and unweighted input networks with built-in evaluation of several extrinsic and intrinsic measures. Our framework is open-source and provides a consistent and systematic way to execute, evaluate and profile clustering techniques considering a number of aspects that are often missing in state-of-the-art frameworks and benchmarking systems.