Comparative Analysis of Static and Contextual Embeddings for Analyzing Semantic Changes in Medieval Latin Charters

TL;DR

This study compares static and contextual embeddings to analyze semantic changes in Medieval Latin charters around the Norman Conquest, demonstrating that contextual embeddings better capture semantic shifts in scarce historical data.

Contribution

First systematic comparison of static and contextual embeddings for semantic change in scarce Medieval Latin data sets.

Findings

Contextual embeddings outperform static embeddings in capturing semantic change.

The analysis provides new insights into linguistic shifts post-Norman Conquest.

First computational study of semantic change in Medieval Latin using embeddings.

Abstract

The Norman Conquest of 1066 C.E. brought profound transformations to England's administrative, societal, and linguistic practices. The DEEDS (Documents of Early England Data Set) database offers a unique opportunity to explore these changes by examining shifts in word meanings within a vast collection of Medieval Latin charters. While computational linguistics typically relies on vector representations of words like static and contextual embeddings to analyze semantic changes, existing embeddings for scarce and historical Medieval Latin are limited and may not be well-suited for this task. This paper presents the first computational analysis of semantic change pre- and post-Norman Conquest and the first systematic comparison of static and contextual embeddings in a scarce historical data set. Our findings confirm that, consistent with existing studies, contextual embeddings outperform static word embeddings in capturing semantic change within a scarce historical corpus.