Bias in Decision-Making for AI's Ethical Dilemmas: A Comparative Study of ChatGPT and Claude

TL;DR

This study systematically evaluates biases in nine large language models' responses to ethical dilemmas, revealing significant protected attribute biases and differences based on model type and dilemma context, emphasizing the need for nuanced fairness assessments.

Contribution

It provides a comprehensive, systematic comparison of ethical biases across multiple LLMs in various dilemma scenarios, highlighting the influence of model type and input complexity.

Findings

All models exhibit significant biases related to protected attributes.

Open-source LLMs show stronger biases towards marginalized groups.

Biases are more pronounced in intersectional attribute scenarios.

Abstract

Recent advances in Large Language Models (LLMs) have enabled human-like responses across various tasks, raising questions about their ethical decision-making capabilities and potential biases. This study systematically evaluates how nine popular LLMs (both open-source and closed-source) respond to ethical dilemmas involving protected attributes. Across 50,400 trials spanning single and intersectional attribute combinations in four dilemma scenarios (protective vs. harmful), we assess models' ethical preferences, sensitivity, stability, and clustering patterns. Results reveal significant biases in protected attributes in all models, with differing preferences depending on model type and dilemma context. Notably, open-source LLMs show stronger preferences for marginalized groups and greater sensitivity in harmful scenarios, while closed-source models are more selective in protective situations and tend to favor mainstream groups. We also find that ethical behavior varies across dilemma types: LLMs maintain consistent patterns in protective scenarios but respond with more diverse and cognitively demanding decisions in harmful ones. Furthermore, models display more pronounced ethical tendencies under intersectional conditions than in single-attribute settings, suggesting that complex inputs reveal deeper biases. These findings highlight the need for multi-dimensional, context-aware evaluation of LLMs' ethical behavior and offer a systematic evaluation and approach to understanding and addressing fairness in LLM decision-making.