Covariate-assisted Grade of Membership Models via Shared Latent Geometry

TL;DR

This paper introduces a novel covariate-assisted grade of membership model that leverages shared low-rank geometry and spectral estimation, improving latent structure recovery without fully specifying joint likelihoods.

Contribution

It proposes a likelihood-free spectral method integrating covariates via shared geometry, with theoretical guarantees and improved efficiency over traditional joint likelihood approaches.

Findings

Covariates enhance latent structure recovery and convergence rates.

The method is computationally efficient and statistically accurate.

Application to educational data demonstrates practical benefits.

Abstract

The grade of membership model is a flexible latent variable model for analyzing multivariate categorical data through individual-level mixed membership scores. In many modern applications, auxiliary covariates are collected alongside responses and encode information about the same latent structure. Traditional approaches to incorporating such covariates typically rely on fully specified joint likelihoods, which are computationally intensive and sensitive to misspecification. We introduce a covariate-assisted grade of membership model that integrates response and covariate information by exploiting their shared low-rank simplex geometry, rather than modeling their joint distribution. We propose a likelihood-free spectral estimation procedure that combines heterogeneous data sources through a balance parameter controlling their relative contribution. To accommodate high-dimensional and heteroskedastic noise, we employ heteroskedastic principal component analysis before performing simplex-based geometric recovery. Our theoretical analysis establishes weaker identifiability conditions than those required in the covariate-free model, and further derives finite-sample, entrywise error bounds for both mixed membership scores and item parameters. These results demonstrate that auxiliary covariates can provably improve latent structure recovery, yielding faster convergence rates in high-dimensional regimes. Simulation studies and an application to educational assessment data illustrate the computational efficiency, statistical accuracy, and interpretability gains of the proposed method. The code for reproducing these results is open-source and available at \texttt{https://github.com/Toby-X/Covariate-Assisted-GoM}