Sequential Confirmatory Factor Analysis: A Novel Approach to Latent Variable Measurement

TL;DR

This paper introduces sequential Confirmatory Factor Analysis, a new hierarchical method that improves factor score estimation in small samples by estimating factors sequentially, reducing bias and convergence issues.

Contribution

The paper presents a novel sequential approach to hierarchical factor analysis that enhances estimation accuracy and convergence, especially in small samples and complex models.

Findings

Sequential CFA outperforms traditional CFA for simple/moderate complexity indices.

Traditional CFA performs better with skewed data.

Sequential CFA provides valid estimates where traditional CFA fails to converge.

Abstract

Factor score estimation in small sample sizes often encounters parameter bias and convergence failures when constructing hierarchical national/sub-national indices. This paper proposes a novel method for hierarchical factor analysis called "sequential Confirmatory Factor Analysis". Instead of estimating multiple levels of factors at the same time, this approach calculates factor scores sequentially from the lowest to highest levels. This sequential estimation keeps the original sample size in each step and also removes cross-level covariance estimation. Using a series of Monte Carlo simulations, we isolate the difference between sequential Confirmatory Factor Analysis and traditional Confirmatory Factor Analysis by comparing their resulting factor scores to the true latent variables under varying conditions. We also estimate the WJP Rule of Law Index using traditional Confirmatory Factor Analysis, Bayesian Confirmatory Factor Analysis, and sequential Confirmatory Factor Analysis to test performance. Our findings demonstrate that sequential Confirmatory Factor Analysis significantly outperforms the traditional model for indices with simple/moderate complexity. Traditional Confirmatory Factor Analysis performs better where the data are skewed. Where the hierarchical model becomes complex, the two methods perform similarly. Finally, sequential Confirmatory Factor Analysis can provide valid estimates where traditional or Bayesian Confirmatory Factor Analysis fail to converge.