Learning Domain-Sensitive and Sentiment-Aware Word Embeddings

TL;DR

This paper introduces a novel method for learning word embeddings that are both domain-sensitive and sentiment-aware, improving sentiment classification across multiple domains by capturing shared and domain-specific semantics.

Contribution

The proposed approach automatically distinguishes and learns domain-common and domain-specific embeddings, enhancing sentiment analysis by capturing nuanced semantic and sentiment information.

Findings

Improved sentiment classification accuracy at sentence and lexicon levels.

Effective differentiation between domain-common and domain-specific words.

Enhanced semantic representations for cross-domain sentiment tasks.

Abstract

Word embeddings have been widely used in sentiment classification because of their efficacy for semantic representations of words. Given reviews from different domains, some existing methods for word embeddings exploit sentiment information, but they cannot produce domain-sensitive embeddings. On the other hand, some other existing methods can generate domain-sensitive word embeddings, but they cannot distinguish words with similar contexts but opposite sentiment polarity. We propose a new method for learning domain-sensitive and sentiment-aware embeddings that simultaneously capture the information of sentiment semantics and domain sensitivity of individual words. Our method can automatically determine and produce domain-common embeddings and domain-specific embeddings. The differentiation of domain-common and domain-specific words enables the advantage of data augmentation of common semantics from multiple domains and capture the varied semantics of specific words from different domains at the same time. Experimental results show that our model provides an effective way to learn domain-sensitive and sentiment-aware word embeddings which benefit sentiment classification at both sentence level and lexicon term level.