# Reduced linguistic coherence in psychosis defies semantic similarity accounts and relates to altered large-scale cortical hierarchy

## TL;DR

Speech coherence in schizophrenia is not well captured by semantic similarity, but relates to brain function and probabilistic language patterns.

## Contribution

The study challenges the use of semantic similarity for measuring speech coherence and highlights altered cortical hierarchy in schizophrenia.

## Key findings

- Semantic similarity metrics poorly correlate with human-rated coherence in speech.
- Probabilistic metrics like perplexity show weak but significant correlations with coherence.
- Reduced speech coherence in schizophrenia is linked to altered brain gradients and probabilistic language patterns.

## Abstract

Coherence in speech is clinically significant in mental disorders but remains difficult to quantify. We tested the widely-held assumption that semantic similarity metrics derived from large language models capture human-rated coherence. Across three large neurotypical datasets in different languages, semantic similarity failed to correlate with human ratings, while six other metrics, especially the probability-based metrics, showed significant but weak correlations. In an additional English dataset of 94 individuals, including healthy controls and patients with schizophrenia spectrum disorders (SSD), speech coherence was reduced in SSD. Incoherence in the drug-naïve first-episode samples related to altered whole-brain intrinsic functional gradients, and to the probabilistic metric of perplexity in speech. Together, these findings call into question semantic similarity as a proxy for coherence, motivate greater emphasis on probabilistic predictability measures for evaluating coherence, and substantiate the perspective of spontaneous speech as an overt readout of an alteration of hierarchical cortical organization in schizophrenia.

The online version contains supplementary material available at 10.1038/s41598-026-39025-1.