SENSE: Semantically Enhanced Node Sequence Embedding

TL;DR

This paper introduces SENSE, a novel method for embedding graph nodes and their sequences by combining structural and textual information, significantly improving accuracy in classification and link prediction tasks.

Contribution

The paper presents SENSE, a new embedding approach that jointly learns node representations with textual descriptions and efficiently encodes node sequences with order preservation.

Findings

SENSE-S improves multi-label classification accuracy by up to 50%.

SENSE-S enhances link prediction accuracy by up to 78%.

The sequence embedding method accurately preserves node order.

Abstract

Effectively capturing graph node sequences in the form of vector embeddings is critical to many applications. We achieve this by (i) first learning vector embeddings of single graph nodes and (ii) then composing them to compactly represent node sequences. Specifically, we propose SENSE-S (Semantically Enhanced Node Sequence Embedding - for Single nodes), a skip-gram based novel embedding mechanism, for single graph nodes that co-learns graph structure as well as their textual descriptions. We demonstrate that SENSE-S vectors increase the accuracy of multi-label classification tasks by up to 50% and link-prediction tasks by up to 78% under a variety of scenarios using real datasets. Based on SENSE-S, we next propose generic SENSE to compute composite vectors that represent a sequence of nodes, where preserving the node order is important. We prove that this approach is efficient in embedding node sequences, and our experiments on real data confirm its high accuracy in node order decoding.