Parsimonious Ultrametric Manly Mixture Models

TL;DR

This paper introduces a new family of parsimonious ultrametric mixture models with the Manly transformation, enhancing clustering of high-dimensional, asymmetric data by improving interpretability and model selection.

Contribution

It develops the extended ultrametric covariance structure combined with the Manly transformation, providing better interpretability and hierarchical insights in clustering high-dimensional data.

Findings

Improved model selection accuracy with the two-step procedure.

Effective clustering performance demonstrated on real data.

Enhanced interpretability through hierarchical visualization within clusters.

Abstract

A family of parsimonious ultrametric mixture models with the Manly transformation is developed for clustering high-dimensional and asymmetric data. Advances in Gaussian mixture modeling sufficiently handle high-dimensional data but struggle with the common presence of skewness. While these advances reduce the number of free parameters, they often provide limited insight into the structure and interpretation of the clusters. To address this shortcoming, this research implements the extended ultrametric covariance structure and the Manly transformation resulting in the parsimonious ultrametric Manly mixture model family. The ultrametric covariance structure reduces the number of free parameters while identifying latent hierarchical relationships between and within groups of variables. This phenomenon allows the visualization of hierarchical relationships within individual clusters, improving cluster interpretability. Additionally, as with many classes of mixture models, model selection remains a fundamental challenge; a two-step model selection procedure is proposed herein. With simulation studies and real data analyses, we demonstrate improved model selection via the proposed two-step method, and the effective clustering performance for the proposed family.