Visualisation for Exploratory Modelling Analysis of Bayesian Hierarchical Models

TL;DR

This paper introduces new visualization techniques to compare Bayesian hierarchical models, aiding model selection and interpretation in data analysis, demonstrated through a case study on international student assessment data.

Contribution

The paper proposes novel visualization methods for comparing Bayesian hierarchical models, enhancing model choice and communication beyond traditional plots and summaries.

Findings

New visualizations improve model comparison clarity

Visualizations help justify hierarchical structure choices

Case study demonstrates practical application and benefits

Abstract

When developing Bayesian hierarchical models, selecting the most appropriate hierarchical structure can be a challenging task, and visualisation remains an underutilised tool in this context. In this paper, we consider visualisations for the display of hierarchical models in data space and compare a collection of multiple models via their parameters and hyper-parameter estimates. Specifically, with the aim of aiding model choice, we propose new visualisations to explore how the choice of Bayesian hierarchical modelling structure impacts parameter distributions. The visualisations are designed using a robust set of principles to provide richer comparisons that extend beyond the conventional plots and numerical summaries typically used. As a case study, we investigate five Bayesian hierarchical models fit using the brms R package, a high-level interface to Stan for Bayesian modelling, to model country mathematics trends from the PISA (Programme for International Student Assessment) database. Our case study demonstrates that by adhering to these principles, researchers can create visualisations that not only help them make more informed choices between Bayesian hierarchical model structures but also enable them to effectively communicate the rationale for those choices.