D-Sempre: Learning Deep Semantic-Preserving Embeddings for User interests-Social Contents Modeling

TL;DR

This paper introduces D-Sempre, a deep learning framework that effectively models user interests and social contents by capturing semantic correlations across multi-modal social media data, improving personalized recommendations.

Contribution

The paper proposes a novel deep semantic-preserving embedding method that bridges semantic gaps in heterogeneous social media data for better user interest modeling.

Findings

D-Sempre effectively integrates multi-modal social media data.

It captures hidden semantic correlations between users and content.

Experimental results show improved modeling accuracy.

Abstract

Exponential growth of social media consumption demands effective user interests-social contents modeling for more personalized recommendation and social media summarization. However, due to the heterogeneous nature of social contents, traditional approaches lack the ability of capturing the hidden semantic correlations across these multi-modal data, which leads to semantic gaps between social content understanding and user interests. To effectively bridge the semantic gaps, we propose a novel deep learning framework for user interests-social contents modeling. We first mine and parse data, i.e. textual content, visual content, social context and social relation, from heterogeneous social media feeds. Then, we design a two-branch network to map the social contents and users into a same latent space. Particularly, the network is trained by a large margin objective that combines a cross-instance distance constraint with a within-instance semantic-preserving constraint in an end-to- end manner. At last, a Deep Semantic-Preserving Embedding (D-Sempre) is learned, and the ranking results can be given by calculating distances between social contents and users. To demonstrate the effectiveness of D-Sempre in user interests-social contents modeling, we construct a Twitter dataset and conduct extensive experiments on it. As a result, D-Sempre effectively integrates the multi-modal data from heterogeneous social media feeds and captures the hidden semantic correlations between users' interests and social contents.