Dynamic Domain Information Modulation Algorithm for Multi-domain Sentiment Analysis

TL;DR

This paper introduces a dynamic domain information modulation algorithm for multi-domain sentiment analysis, improving efficiency and performance by adaptively adjusting domain information during training across multiple domains.

Contribution

The paper proposes a novel two-stage domain-aware modulation algorithm that dynamically adjusts domain information, addressing challenges of existing hyperparameter optimization in multi-domain sentiment classification.

Findings

Outperforms existing methods on a 16-domain dataset

Reduces computational resources compared to hyperparameter tuning

Achieves better sentiment classification accuracy

Abstract

Multi-domain sentiment classification aims to mitigate poor performance models due to the scarcity of labeled data in a single domain, by utilizing data labeled from various domains. A series of models that jointly train domain classifiers and sentiment classifiers have demonstrated their advantages, because domain classification helps generate necessary information for sentiment classification. Intuitively, the importance of sentiment classification tasks is the same in all domains for multi-domain sentiment classification; but domain classification tasks are different because the impact of domain information on sentiment classification varies across different fields; this can be controlled through adjustable weights or hyper parameters. However, as the number of domains increases, existing hyperparameter optimization algorithms may face the following challenges: (1) tremendous demand for computing resources, (2) convergence problems, and (3) high algorithm complexity. To efficiently generate the domain information required for sentiment classification in each domain, we propose a dynamic information modulation algorithm. Specifically, the model training process is divided into two stages. In the first stage, a shared hyperparameter, which would control the proportion of domain classification tasks across all fields, is determined. In the second stage, we introduce a novel domain-aware modulation algorithm to adjust the domain information contained in the input text, which is then calculated based on a gradient-based and loss-based method. In summary, experimental results on a public sentiment analysis dataset containing 16 domains prove the superiority of the proposed method.