# Detection of Block-Exchangeable Structure in Large-Scale Correlation   Matrices

**Authors:** Samuel Perreault, Thierry Duchesne, Johanna G. Ne\v{s}lehov\'a

arXiv: 1706.05940 · 2024-10-24

## TL;DR

This paper introduces a robust method using Kendall's rank correlation to detect block structures in large correlation matrices, especially when variables form exchangeable clusters, improving estimation accuracy in high-dimensional data.

## Contribution

It proposes a new algorithm for identifying exchangeable clusters in correlation matrices without prior knowledge of the number of clusters, enhancing estimation in high-dimensional settings.

## Key findings

- The estimator outperforms sample Kendall correlation when K < d.
- It is more efficient in finite samples even when K = d.
- The method extends to linear correlations under elliptical distributions.

## Abstract

Correlation matrices are omnipresent in multivariate data analysis. When the number d of variables is large, the sample estimates of correlation matrices are typically noisy and conceal underlying dependence patterns. We consider the case when the variables can be grouped into K clusters with exchangeable dependence; this assumption is often made in applications, e.g., in finance and econometrics. Under this partial exchangeability condition, the corresponding correlation matrix has a block structure and the number of unknown parameters is reduced from d(d-1)/2 to at most K(K+1)/2. We propose a robust algorithm based on Kendall's rank correlation to identify the clusters without assuming the knowledge of K a priori or anything about the margins except continuity. The corresponding block-structured estimator performs considerably better than the sample Kendall rank correlation matrix when K < d. The new estimator can also be much more efficient in finite samples even in the unstructured case K = d, although there is no gain asymptotically. When the distribution of the data is elliptical, the results extend to linear correlation matrices and their inverses. The procedure is illustrated on financial stock returns.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1706.05940/full.md

## Figures

55 figures with captions in the complete paper: https://tomesphere.com/paper/1706.05940/full.md

## References

51 references — full list in the complete paper: https://tomesphere.com/paper/1706.05940/full.md

---
Source: https://tomesphere.com/paper/1706.05940