The Effect of Context on Metaphor Paraphrase Aptness Judgments
Yuri Bizzoni, Shalom Lappin

TL;DR
This paper investigates how context influences human and AI judgments of metaphor paraphrase aptness, revealing that context tends to compress ratings towards the middle of the scale.
Contribution
It introduces a study on the impact of context on aptness judgments and develops a DNN model to predict these judgments, highlighting the context-induced compression effect.
Findings
Context compresses aptness scores towards the center.
DNN model effectively predicts human judgments.
Adding context alters paraphrase ratings significantly.
Abstract
We conduct two experiments to study the effect of context on metaphor paraphrase aptness judgments. The first is an AMT crowd source task in which speakers rank metaphor paraphrase candidate sentence pairs in short document contexts for paraphrase aptness. In the second we train a composite DNN to predict these human judgments, first in binary classifier mode, and then as gradient ratings. We found that for both mean human judgments and our DNN's predictions, adding document context compresses the aptness scores towards the center of the scale, raising low out of context ratings and decreasing high out of context scores. We offer a provisional explanation for this compression effect.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsLanguage, Metaphor, and Cognition · Topic Modeling · Sentiment Analysis and Opinion Mining
