Small Area Estimation with Random Forests and the LASSO

TL;DR

This paper compares random forests, LASSO, and other methods for small area estimation using auxiliary data, proposing a new uncertainty measure, with application to Ghanaian household consumption data.

Contribution

It introduces a modified conformal procedure for uncertainty quantification in random forests and LASSO within small area estimation, applied to real survey data.

Findings

Bayesian shrinkage method had the best bias and MSE performance.

Significant variation in household consumption across areas was observed.

The proposed uncertainty measure effectively captures estimate variability.

Abstract

We consider random forests and LASSO methods for model-based small area estimation when the number of areas with sampled data is a small fraction of the total areas for which estimates are required. Abundant auxiliary information is available for the sampled areas, from the survey, and for all areas, from an exterior source, and the goal is to use auxiliary variables to predict the outcome of interest. We compare areal-level random forests and LASSO approaches to a frequentist forward variable selection approach and a Bayesian shrinkage method. Further, to measure the uncertainty of estimates obtained from random forests and the LASSO, we propose a modification of the split conformal procedure that relaxes the assumption of identically distributed data. This work is motivated by Ghanaian data available from the sixth Living Standard Survey (GLSS) and the 2010 Population and Housing Census. We estimate the areal mean household log consumption using both datasets. The outcome variable is measured only in the GLSS for 3\% of all the areas (136 out of 5019) and more than 170 potential covariates are available from both datasets. Among the four modelling methods considered, the Bayesian shrinkage performed the best in terms of bias, MSE and prediction interval coverages and scores, as assessed through a cross-validation study. We find substantial between-area variation, the log consumption areal point estimates showing a 1.3-fold variation across the GAMA region. The western areas are the poorest while the Accra Metropolitan Area district gathers the richest areas.