Identifying Quantum Mechanical Statistics in Italian Corpora

TL;DR

This paper investigates the statistical distribution of words in Italian texts, revealing they follow Bose-Einstein statistics and exhibit quantum-like clustering due to meaning and context, with implications for understanding language and physics.

Contribution

It generalizes a theoretical framework to identify quantum statistical patterns in language and demonstrates their presence in Italian texts, extending previous findings from English.

Findings

Words follow Bose-Einstein statistics in Italian texts

Word clustering is linked to meaning and context, resembling quantum entanglement

Word randomization reduces quantum effects, akin to increasing temperature in physics

Abstract

We present a theoretical and empirical investigation of the statistical behaviour of the words in a text produced by human language. To this aim, we analyse the word distribution of various texts of Italian language selected from a specific literary corpus. We firstly generalise a theoretical framework elaborated by ourselves to identify 'quantum mechanical statistics' in large-size texts. Then, we show that, in all analysed texts, words distribute according to 'Bose--Einstein statistics' and show significant deviations from 'Maxwell--Boltzmann statistics'. Next, we introduce an effect of 'word randomization' which instead indicates that the difference between the two statistical models is not as pronounced as in the original cases. These results confirm the empirical patterns obtained in texts of English language and strongly indicate that identical words tend to 'clump together' as a consequence of their meaning, which can be explained as an effect of 'quantum entanglement' produced through a phenomenon of 'contextual updating'. More, word randomization can be seen as the linguistic-conceptual equivalent of an increase of temperature which destroys 'coherence' and makes classical statistics prevail over quantum statistics. Some insights into the origin of quantum statistics in physics are finally provided.