Testing for latent structure via the Wilcoxon--Wigner random matrix of normalized rank statistics

TL;DR

This paper introduces Wilcoxon--Wigner random matrices for testing latent structures in large data matrices, providing a flexible, computationally efficient spectral method with asymptotic Gaussian fluctuations for community and submatrix detection.

Contribution

It develops a novel spectral testing approach based on Wilcoxon--Wigner matrices, bridging nonparametrics and multivariate analysis, with explicit asymptotic results for eigenvalues.

Findings

Eigenvalues and eigenvectors have asymptotically Gaussian fluctuations.

The method is distribution-free and parameter-free.

Numerical examples demonstrate effective detection performance.

Abstract

This paper considers the problem of testing for latent structure in large symmetric data matrices. The goal here is to develop statistically principled methodology that is flexible in its applicability, computationally efficient, and insensitive to extreme data variation, thereby overcoming limitations facing existing approaches. To do so, we introduce and systematically study certain symmetric matrices, called Wilcoxon--Wigner random matrices, whose entries are normalized rank statistics derived from an underlying independent and identically distributed sample of absolutely continuous random variables. These matrices naturally arise as the matricization of one-sample problems in statistics and conceptually lie at the interface of nonparametrics, multivariate analysis, and data reduction. Among our results, we establish that the leading eigenvalue and corresponding eigenvector of Wilcoxon--Wigner random matrices admit asymptotically Gaussian fluctuations with explicit centering and scaling terms. These asymptotic results enable rigorous parameter-free and distribution-free spectral methodology for addressing two hypothesis testing problems, namely community detection and principal submatrix detection. Numerical examples illustrate the performance of the proposed approach. Throughout, our findings are juxtaposed with existing results based on the spectral properties of independent entry symmetric random matrices in signal-plus-noise data settings.