Can Large Language Models Detect Verbal Indicators of Romantic Attraction?

TL;DR

This study investigates whether Large Language Models like ChatGPT can detect romantic attraction cues during speed dating, showing modest predictive ability comparable to humans and revealing shared linguistic indicators.

Contribution

The paper demonstrates that ChatGPT can predict romantic interest indicators from brief interactions, providing insights into social cue detection by AI in romantic contexts.

Findings

ChatGPT predicts speed dating success with correlations r=0.12-0.23.

ChatGPT's predictions are comparable to human judges.

Linguistic cues used by ChatGPT overlap with those of humans.

Abstract

As artificial intelligence (AI) models become an integral part of everyday life, our interactions with them shift from purely functional exchanges to more relational experiences. For these experiences to be successful, artificial agents need to be able to detect and interpret social cues and interpersonal dynamics; both within and outside of their own human-agent relationships. In this paper, we explore whether AI models can accurately decode one of the arguably most important but complex social signals: romantic attraction. Specifically, we test whether Large Language Models can detect romantic attraction during brief getting-to-know-you interactions between humans. Examining data from 964 speed dates, we show that ChatGPT can predict both objective and subjective indicators of speed dating success (r=0.12-0.23). Although predictive performance remains relatively low, ChatGPT's predictions of actual matching (i.e., the exchange of contact information) were not only on par with those of human judges but incremental to speed daters' own predictions. In addition, ChatGPT's judgments showed substantial overlap with those made by human observers (r=0.21-0.35), highlighting similarities in their representation of romantic attraction that are independent of accuracy. Our findings also offer insights into how ChatGPT arrives at its predictions and the mistakes it makes. Specifically, we use a Brunswik lens approach to identify the linguistic and conversational cues utilized by ChatGPT (and human judges) vis-a-vis those that are predictive of actual matching.