Can LLMs Express Personality Across Cultures? Introducing CulturalPersonas for Evaluating Trait Alignment
Priyanka Dey, Yugal Khanter, Aayush Bothra, Jieyu Zhao, Emilio Ferrara

TL;DR
This paper introduces CulturalPersonas, a large-scale benchmark for evaluating how well LLMs can express personality in culturally appropriate ways across diverse countries, addressing the gap between personality and cultural context.
Contribution
It presents the first culturally grounded benchmark with human validation for assessing LLMs' personality expression across different cultural contexts.
Findings
CulturalPersonas reduces Wasserstein distance by over 20% across models and countries.
LLMs show improved alignment with country-specific personality distributions.
CulturalPersonas elicits more culturally coherent and expressive responses.
Abstract
As LLMs become central to interactive applications, ranging from tutoring to mental health, the ability to express personality in culturally appropriate ways is increasingly important. While recent works have explored personality evaluation of LLMs, they largely overlook the interplay between culture and personality. To address this, we introduce CulturalPersonas, the first large-scale benchmark with human validation for evaluating LLMs' personality expression in culturally grounded, behaviorally rich contexts. Our dataset spans 3,000 scenario-based questions across six diverse countries, designed to elicit personality through everyday scenarios rooted in local values. We evaluate three LLMs, using both multiple-choice and open-ended response formats. Our results show that CulturalPersonas improves alignment with country-specific human personality distributions (over a 20% reduction in…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsPersonality Traits and Psychology · Personality Disorders and Psychopathology · Mental Health via Writing
