MDE: Modality Discrimination Enhancement for Multi-modal Recommendation
Hang Zhou, Yucheng Wang, Huijing Zhan

TL;DR
This paper introduces MDE, a framework that improves multi-modal recommendation by effectively capturing both shared and unique features across modalities, leading to better recommendation accuracy.
Contribution
The paper proposes a novel MDE framework that emphasizes modality-specific features and balances shared and distinct information for enhanced multi-modal recommendation.
Findings
MDE significantly outperforms state-of-the-art methods on three datasets.
The multi-modal fusion module effectively enhances modality differences.
The node-level trade-off mechanism balances alignment and differentiation.
Abstract
Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two challenges: preserving semantic commonality across modalities (modality-shared) and capturing unique characteristics for each modality (modality-specific). Most existing approaches focus on aligning feature spaces across modalities, which helps represent modality-shared features. However, modality-specific distinctions are often neglected, especially when there are significant semantic variations between modalities. To address this, we propose a Modality Distinctiveness Enhancement (MDE) framework that prioritizes extracting modality-specific information to improve recommendation accuracy while maintaining shared features. MDE enhances differences…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsRecommender Systems and Techniques · Sentiment Analysis and Opinion Mining · Advanced Graph Neural Networks
MethodsFocus
