Pay attention to emoji: Feature Fusion Network with EmoGraph2vec Model for Sentiment Analysis

TL;DR

This paper introduces EmoGraph2vec, a novel emoji representation learning method that leverages social co-occurrence data and EmojiNet to enhance sentiment analysis by better capturing emoji-text emotional interactions.

Contribution

The study proposes EmoGraph2vec for enriched emoji embeddings and a hybrid-attention neural network for improved sentiment analysis performance.

Findings

Outperforms baseline models on benchmark datasets

Effectively captures emoji-text emotional interactions

Enhances interpretability of sentiment analysis models

Abstract

With the explosive growth of social media, opinionated postings with emojis have increased explosively. Many emojis are used to express emotions, attitudes, and opinions. Emoji representation learning can be helpful to improve the performance of emoji-related natural language processing tasks, especially in text sentiment analysis. However, most studies have only utilized the fixed descriptions provided by the Unicode Consortium without consideration of actual usage scenarios. As for the sentiment analysis task, many researchers ignore the emotional impact of the interaction between text and emojis. It results that the emotional semantics of emojis cannot be fully explored. In this work, we propose a method called EmoGraph2vec to learn emoji representations by constructing a co-occurrence graph network from social data and enriching the semantic information based on an external knowledge base EmojiNet to embed emoji nodes. Based on EmoGraph2vec model, we design a novel neural network to incorporate text and emoji information into sentiment analysis, which uses a hybrid-attention module combined with TextCNN-based classifier to improve performance. Experimental results show that the proposed model can outperform several baselines for sentiment analysis on benchmark datasets. Additionally, we conduct a series of ablation and comparison experiments to investigate the effectiveness and interpretability of our model.