MoralStrength: Exploiting a Moral Lexicon and Embedding Similarity for Moral Foundations Prediction

TL;DR

This paper introduces MoralStrength, a new moral lexicon with assessments, and demonstrates its effectiveness in predicting moral foundations in text, significantly outperforming previous methods across multiple datasets.

Contribution

MoralStrength extends the Moral Foundations Dictionary with about 1,000 lemmas and moral valence scores, and explores various approaches including deep learning for moral prediction.

Findings

Logistic regression with MoralStrength features achieved an F1-score of 87.6%.

Outperformed previous state-of-the-art with a significant margin.

Effective across six different datasets.

Abstract

Moral rhetoric plays a fundamental role in how we perceive and interpret the information we receive, greatly influencing our decision-making process. Especially when it comes to controversial social and political issues, our opinions and attitudes are hardly ever based on evidence alone. The Moral Foundations Dictionary (MFD) was developed to operationalize moral values in the text. In this study, we present MoralStrength, a lexicon of approximately 1,000 lemmas, obtained as an extension of the Moral Foundations Dictionary, based on WordNet synsets. Moreover, for each lemma it provides with a crowdsourced numeric assessment of Moral Valence, indicating the strength with which a lemma is expressing the specific value. We evaluated the predictive potentials of this moral lexicon, defining three utilization approaches of increased complexity, ranging from lemmas' statistical properties to a deep learning approach of word embeddings based on semantic similarity. Logistic regression models trained on the features extracted from MoralStrength, significantly outperformed the current state-of-the-art, reaching an F1-score of 87.6% over the previous 62.4% (p-value<0.01), and an average F1-Score of 86.25% over six different datasets. Such findings pave the way for further research, allowing for an in-depth understanding of moral narratives in text for a wide range of social issues.