Visualization According to Statisticians: An Interview Study on the Role of Visualization for Inferential Statistics

TL;DR

This study explores how professional statisticians use visualization throughout their inferential analysis process, revealing their visual-based mental models and suggesting improved visual representations to enhance understanding of statistical uncertainty.

Contribution

It provides new insights into statisticians' visualization practices and mental models, and offers design recommendations for visualizing statistical inferences.

Findings

Statisticians extensively use visualization in all analytic phases.

Their mental models of inferential methods are predominantly visual.

Many statisticians dislike dichotomous thinking, favoring nuanced visual displays.

Abstract

Statisticians are not only one of the earliest professional adopters of data visualization, but also some of its most prolific users. Understanding how these professionals utilize visual representations in their analytic process may shed light on best practices for visual sensemaking. We present results from an interview study involving 18 professional statisticians (19.7 years average in the profession) on three aspects: (1) their use of visualization in their daily analytic work; (2) their mental models of inferential statistical processes; and (3) their design recommendations for how to best represent statistical inferences. Interview sessions consisted of discussing inferential statistics, eliciting participant sketches of suitable visual designs, and finally, a design intervention with our proposed visual designs. We analyzed interview transcripts using thematic analysis and open coding, deriving thematic codes on statistical mindset, analytic process, and analytic toolkit. The key findings for each aspect are as follows: (1) statisticians make extensive use of visualization during all phases of their work (and not just when reporting results); (2) their mental models of inferential methods tend to be mostly visually based; and (3) many statisticians abhor dichotomous thinking. The latter suggests that a multi-faceted visual display of inferential statistics that includes a visual indicator of analytically important effect sizes may help to balance the attributed epistemic power of traditional statistical testing with an awareness of the uncertainty of sensemaking.