SynPAIN: A Synthetic Dataset of Pain and Non-Pain Facial Expressions

TL;DR

SynPAIN is a large, diverse synthetic facial expression dataset designed to improve automated pain detection, especially for older adults, and to evaluate and reduce algorithmic bias.

Contribution

The paper introduces SynPAIN, the first publicly available synthetic dataset with demographic diversity for pain detection, and demonstrates its utility in bias evaluation and performance enhancement.

Findings

Synthetic pain expressions show expected pain patterns.

Bias evaluation reveals significant performance disparities across demographics.

Age-matched synthetic data augmentation improves real-world pain detection accuracy.

Abstract

Accurate pain assessment in patients with limited ability to communicate, such as older adults with severe dementia, represents a critical healthcare challenge. Robust automated systems of pain behavior detection may facilitate such assessments. Existing pain detection datasets, however, suffer from limited ethnic/racial diversity, privacy constraints, and underrepresentation of older adults who are the primary target population for clinical deployment. We present SynPAIN, a large-scale synthetic dataset containing 10,710 facial expression images across five ethnicities/races, representing two age groups, and two genders. Using commercial generative AI tools, we created demographically balanced synthetic identities with clinically meaningful pain expressions. Our validation demonstrates that synthetic pain expressions exhibit expected pain patterns, scoring significantly higher than neutral and non-pain expressions using clinically validated pain assessment tools based on facial action unit analysis. We experimentally demonstrate SynPAIN's utility in identifying algorithmic bias in existing pain detection models. Through comprehensive bias evaluation, we reveal substantial performance disparities across demographics characteristics. These performance disparities were previously undetectable with smaller, less diverse datasets. Furthermore, we demonstrate that age-matched synthetic data augmentation improves pain detection performance on real clinical data, achieving a 2.4 percentage point improvement in average precision. SynPAIN addresses critical gaps in pain assessment research by providing the first publicly available, demographically diverse synthetic dataset specifically designed for older adult pain detection, while establishing a framework for measuring and mitigating algorithmic bias. The dataset, code, and trained models is available at https://mmzml.github.io/SynPAIN