Multi-view predictive partitioning in high dimensions

TL;DR

This paper introduces MVPP, a multi-view clustering algorithm that maximizes within-cluster predictive similarity using TB-PLS regression, effectively handling high-dimensional data in applications like web mining and genomics.

Contribution

The paper presents a novel clustering method based on predictive similarity and TB-PLS regression, improving multi-view clustering in high-dimensional settings.

Findings

MVPP outperforms existing multi-view clustering methods in simulations.

MVPP achieves state-of-the-art results on benchmark web mining datasets.

The method effectively captures predictive relationships between views.

Abstract

Many modern data mining applications are concerned with the analysis of datasets in which the observations are described by paired high-dimensional vectorial representations or "views". Some typical examples can be found in web mining and genomics applications. In this article we present an algorithm for data clustering with multiple views, Multi-View Predictive Partitioning (MVPP), which relies on a novel criterion of predictive similarity between data points. We assume that, within each cluster, the dependence between multivariate views can be modelled by using a two-block partial least squares (TB-PLS) regression model, which performs dimensionality reduction and is particularly suitable for high-dimensional settings. The proposed MVPP algorithm partitions the data such that the within-cluster predictive ability between views is maximised. The proposed objective function depends on a measure of predictive influence of points under the TB-PLS model which has been derived as an extension of the PRESS statistic commonly used in ordinary least squares regression. Using simulated data, we compare the performance of MVPP to that of competing multi-view clustering methods which rely upon geometric structures of points, but ignore the predictive relationship between the two views. State-of-art results are obtained on benchmark web mining datasets.