Covariate Selection for Joint Latent Space Modeling of Sparse Network Data

TL;DR

This paper introduces a joint latent space modeling framework for sparse network data with high-dimensional binary covariates, enabling covariate selection while accounting for latent position uncertainty and improving predictive accuracy.

Contribution

It proposes a novel covariate selection method combining joint latent space models, group lasso screening, and measurement-error stabilization for sparse networks.

Findings

Method maintains stable predictive performance with increasing covariate sparsity.

Simulation results confirm robustness of the approach compared to naive methods.

Application to Indian village networks demonstrates efficient study design with reduced data collection.

Abstract

Network data are increasingly common in the social sciences and infectious disease epidemiology. Analyses often link network structure to node-level covariates, but existing methods falter with sparse networks and high-dimensional node features. We propose a joint latent space modeling framework for sparse networks with high-dimensional binary node covariates that performs covariate selection while accounting for uncertainty in estimated latent positions. Building on joint latent space models that couple edges and node variables through shared latent positions, we introduce a group lasso screening step and incorporate a measurement-error-aware stabilization term to mitigate bias from using estimated latent positions as predictors. We establish prediction error rates for the covariate component both when latent positions are treated as observed and when they are estimated with bounded error; under uniform control across $q$ covariates and $n$ nodes, the rate is of order $O(\log q / n)$ up to an additional term due to latent position estimation error. Our method addresses three challenges: (1) incorporating information from isolated nodes, which are common in sparse networks but often ignored; (2) selecting relevant covariates from high-dimensional spaces; and (3) accounting for uncertainty in estimated latent positions. Simulations show predictive performance remains stable as covariate sparsity grows, while naive approaches degrade. We illustrate how the method can support efficient study design using household social networks from 75 Indian villages, where an emulated pilot study screens a large covariate battery and substantially reduces required subsequent data collection without sacrificing network predictive accuracy.