Sparse Bayesian Factor Models with Mass-Nonlocal Factor Scores

TL;DR

This paper introduces BFMAN, a Bayesian factor model with a novel mass-nonlocal prior on factor scores, improving sparsity, heterogeneity modeling, and factor number determination in high-dimensional data analysis.

Contribution

The paper proposes a new Bayesian factor model with a mass-nonlocal prior on factor scores, enhancing interpretability and robustness over traditional models.

Findings

BFMAN outperforms standard models in factor recovery and sparsity detection.

The model accurately estimates the number of factors.

Application reveals meaningful dietary patterns linked to health outcomes.

Abstract

Bayesian factor models are widely used for dimensionality reduction and pattern discovery in high-dimensional datasets across diverse fields. These models typically focus on imposing priors on factor loading to induce sparsity and improve interpretability. However, factor scores, which play a critical role in individual-level associations with factors, have received less attention and are assumed to follow a standard normal distribution. This assumption oversimplifies the heterogeneity often observed in real-world applications. We propose the sparse Bayesian Factor model with MAss-Nonlocal factor scores (BFMAN), a novel framework that addresses these limitations by introducing a mass-nonlocal prior on factor scores. This prior allows for both exact zeros and flexible, nonlocal behavior, capturing individual-level sparsity and heterogeneity. The sparsity in the score matrix enables a robust and novel approach to determine the optimal number of factors. Model parameters are estimated via a fast and efficient Gibbs sampler. Extensive simulations demonstrate that BFMAN outperforms standard Bayesian factor models in factor recovery, sparsity detection, score estimation, and selection of the optimal number of factors. We apply BFMAN to the Hispanic Community Health Study/Study of Latinos, identifying meaningful dietary patterns and their associations with cardiovascular disease, showcasing the model's ability to uncover insights into complex nutritional data.