Self-Supervised Temporal Graph learning with Temporal and Structural Intensity Alignment

TL;DR

This paper introduces S2T, a self-supervised method for temporal graph learning that combines temporal and structural information to produce more informative node representations, significantly improving performance over existing methods.

Contribution

The paper proposes a novel approach that aligns temporal and structural intensities in temporal graphs, incorporating high-order structural information and an alignment loss for enhanced node representations.

Findings

Achieves up to 10.13% performance improvement over state-of-the-art methods.

Effectively models both local and global structural information.

Demonstrates robustness across multiple datasets.

Abstract

Temporal graph learning aims to generate high-quality representations for graph-based tasks with dynamic information, which has recently garnered increasing attention. In contrast to static graphs, temporal graphs are typically organized as node interaction sequences over continuous time rather than an adjacency matrix. Most temporal graph learning methods model current interactions by incorporating historical neighborhood. However, such methods only consider first-order temporal information while disregarding crucial high-order structural information, resulting in suboptimal performance. To address this issue, we propose a self-supervised method called S2T for temporal graph learning, which extracts both temporal and structural information to learn more informative node representations. Notably, the initial node representations combine first-order temporal and high-order structural information differently to calculate two conditional intensities. An alignment loss is then introduced to optimize the node representations, narrowing the gap between the two intensities and making them more informative. Concretely, in addition to modeling temporal information using historical neighbor sequences, we further consider structural knowledge at both local and global levels. At the local level, we generate structural intensity by aggregating features from high-order neighbor sequences. At the global level, a global representation is generated based on all nodes to adjust the structural intensity according to the active statuses on different nodes. Extensive experiments demonstrate that the proposed model S2T achieves at most 10.13% performance improvement compared with the state-of-the-art competitors on several datasets.