Semantic distance organizes social knowledge: Insights from semantic dementia and cross-modal conceptual space

TL;DR

This study investigates how semantic distances between social concepts influence organization and errors in social knowledge, especially in semantic dementia patients, using a novel triplet embedding approach for words and images.

Contribution

It introduces a unified triplet embedding method for social words and images and links semantic distances to error patterns in semantic dementia patients.

Findings

Semantic distances predict error patterns in SD patients.

Gender information is more robust than age in SD.

Age-related errors correlate with linear age distance in the embedding.

Abstract

Our interaction with others largely hinges on how we semantically organize the social world. The organization of such conceptual information is not static -- as we age, our experiences and ever-changing anatomy alter how we represent and arrange semantic information. How does semantic distance between concepts affect this organization, particularly for those with pathological deficits in semantic knowledge? Using triplet judgment responses collected from healthy participants, we compute an ordinal similarity embedding for a set of social words and images that vary in the dimensions of age and gender. We compare semantic distances between items in the space to patterns of error in a word-picture matching task performed by patients with semantic dementia (SD). Error patterns reveal that SD patients retain gender information more robustly than age information, and that age-related errors are a function of linear distance in age from a concept word. The distances between probed and exemplar items in the resulting conceptual map reflect error patterns in SD patient responses such that items semantically closer to a probed concept -- in gender category or in linear age -- are more likely to be erroneously chosen by patients in a word-picture matching task. To our knowledge, this is the first triplet embedding work to embed representations of words and images in a unified space, and to use this space to explain patterns of behavior in patients with impaired social semantic cognition.