DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Life
Yu Ying Chiu, Liwei Jiang, Yejin Choi

TL;DR
DailyDilemmas introduces a dataset of everyday moral dilemmas to evaluate and analyze the value preferences of large language models across various ethical frameworks, revealing insights into their decision-making and alignment with human values.
Contribution
The paper presents a new dataset, DailyDilemmas, and a comprehensive analysis of LLMs' moral decision-making aligned with multiple theoretical value frameworks.
Findings
LLMs favor self-expression over survival in World Values Survey.
Models show a preference for care over loyalty in Moral Foundations Theory.
Significant differences in core value prioritization among models, e.g., truthfulness.
Abstract
As users increasingly seek guidance from LLMs for decision-making in daily life, many of these decisions are not clear-cut and depend significantly on the personal values and ethical standards of people. We present DailyDilemmas, a dataset of 1,360 moral dilemmas encountered in everyday life. Each dilemma presents two possible actions, along with affected parties and relevant human values for each action. Based on these dilemmas, we gather a repository of human values covering diverse everyday topics, such as interpersonal relationships, workplace, and environmental issues. With DailyDilemmas, we evaluate LLMs on these dilemmas to determine what action they will choose and the values represented by these action choices. Then, we analyze values through the lens of five theoretical frameworks inspired by sociology, psychology, and philosophy, including the World Values Survey, Moral…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsAdvanced Text Analysis Techniques · Stock Market Forecasting Methods · Data Mining Algorithms and Applications
MethodsSparse Evolutionary Training
