# Understanding lightbulb moments: Meaning-making in visual morphology from comics and emoji

## TL;DR

The paper explores how people interpret visual symbols like lightbulbs over heads to mean abstract ideas like inspiration.

## Contribution

It introduces a combinatorial method combining verbal and visual modalities to study non-literal expressions in memory.

## Key findings

- Literal words speed up responses when presented before images with matching upfixes.
- Non-literal words are processed faster when upfixes match facial expressions in images.
- Non-literal meanings are better remembered when they align with facial expressions.

## Abstract

How do we interpret a lightbulb above a head in visual images to mean inspiration? We investigated the semantic processing of these “upfixes” like lightbulbs or gears that float above characters' heads. We examined the congruity of face-upfix dyads presented sequentially with words describing their literal (“lightbulb”) or non-literal meanings (“inspiration”). To examine if upfixes alone sponsor meanings, we showed participants upfixes that either matched or mismatched the facial expression (e.g., lightbulb over an excited vs. sad face). Literal words always evoked faster response times for face-upfix dyads when presented before the images. When images appeared before words, participants responded faster to non-literal words for matching dyads than mismatching dyads. On the other hand, when literal words appeared before images, participants responded faster to matching dyads than mismatching dyads. Non-literal words were rated as more congruous with matching dyads, while literal words were more congruous with mismatching dyads. Thus, non-literal upfix meanings (e.g., inspiration) are ingrained in memory only when they match facial expressions, supporting the notion that they belong to a constrained visual lexicon. Our study contributes a combinatorial method of both verbal and visual modalities into the study of non-literal expressions in memory.