Measuring Large Language Models Dependency: Validating the Arabic Version of the LLM-D12 Scale

TL;DR

This study validates the Arabic version of the LLM-D12 scale, a reliable tool for assessing dependency on large language models among Arabic speakers, facilitating research and policy development in this context.

Contribution

It is the first to culturally validate the LLM-D12 scale in Arabic, confirming its structure, reliability, and sensitivity to use and personal factors.

Findings

The Arabic LLM-D12 has a confirmed 2-factor structure.

The scale shows high internal reliability (Cronbach's alpha > 0.85).

Instrumental dependency correlates with AI acceptance and internet addiction.

Abstract

There is an urgent need for reliable, culturally validated instruments to assess psychological responses to AI in general and large language models (LLMs). This need is global issue, but it is especially urgent among Arabic-speaking populations, where AI and LLMs adoption is accelerating, yet psychometric tools remain limited. This study presents the first validation of the LLM-D12, a dual-dimensional scale assessing Instrumental and Relationship Dependency on LLMs, in an Arab sample. A total of 250 Arab participants completed the Arabic version of the LLM-D12. Confirmatory Factor Analysis confirms the original 2-factor structure of LLM-D12 with all items showing good loading of corresponding Instrumental and Relationship Dependency. The scale showed good to excellent internal reliability (Cronbach alpha is 0.90 for Total, 0.85 for Instrumental Dependency, and 0.90 for Relationship Dependency). External validation revealed that Instrumental Dependency was positively associated with AI acceptance and internet addiction, while Relationship Dependency was linked to lower need for cognition and greater trustworthiness of LLM, demonstrating sensitivity of this instrument to different use and personal factors. These findings confirm that Arabic LLM-D12 is a psychometrically sound, culturally appropriate instrument, offering a necessary tool for research, education, and policy concerning AI and LLMs engagement in Arab contexts.