Multi-level Conflict-Aware Network for Multi-modal Sentiment Analysis
Yubo Gao, Haotian Wu, Lei Zhang

TL;DR
This paper introduces a multi-level conflict-aware network for multimodal sentiment analysis that effectively distinguishes and exploits alignment and conflict between modalities without relying on unstable labels.
Contribution
It proposes a novel network that segregates and models conflicts at multiple levels, improving multimodal sentiment analysis performance.
Findings
Effective conflict modeling improves sentiment recognition accuracy.
The method outperforms existing approaches on CMU-MOSI and CMU-MOSEI datasets.
Conflict-aware approach enhances multimodal interaction understanding.
Abstract
Multimodal Sentiment Analysis (MSA) aims to recognize human emotions by exploiting textual, acoustic, and visual modalities, and thus how to make full use of the interactions between different modalities is a central challenge of MSA. Interaction contains alignment and conflict aspects. Current works mainly emphasize alignment and the inherent differences between unimodal modalities, neglecting the fact that there are also potential conflicts between bimodal combinations. Additionally, multi-task learning-based conflict modeling methods often rely on the unstable generated labels. To address these challenges, we propose a novel multi-level conflict-aware network (MCAN) for multimodal sentiment analysis, which progressively segregates alignment and conflict constituents from unimodal and bimodal representations, and further exploits the conflict constituents with the conflict modeling…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSentiment Analysis and Opinion Mining · Topic Modeling
