Self-supervised Learning for Heterogeneous Graph via Structure Information based on Metapath

TL;DR

This paper introduces SESIM, a self-supervised learning method for heterogeneous graphs that leverages structure information via metapaths to improve node representations without manual labels.

Contribution

It proposes a novel pretext task predicting jump numbers in metapaths, utilizing graph structure data itself, and employs meta-learning to balance tasks, advancing self-supervised learning for heterogeneous graphs.

Findings

SESIM improves link prediction accuracy.

SESIM enhances node classification performance.

The method effectively utilizes graph structure information.

Abstract

graph neural networks (GNNs) are the dominant paradigm for modeling and handling graph structure data by learning universal node representation. The traditional way of training GNNs depends on a great many labeled data, which results in high requirements on cost and time. In some special scene, it is even unavailable and impracticable. Self-supervised representation learning, which can generate labels by graph structure data itself, is a potential approach to tackle this problem. And turning to research on self-supervised learning problem for heterogeneous graphs is more challenging than dealing with homogeneous graphs, also there are fewer studies about it. In this paper, we propose a SElfsupervised learning method for heterogeneous graph via Structure Information based on Metapath (SESIM). The proposed model can construct pretext tasks by predicting jump number between nodes in each metapath to improve the representation ability of primary task. In order to predict jump number, SESIM uses data itself to generate labels, avoiding time-consuming manual labeling. Moreover, predicting jump number in each metapath can effectively utilize graph structure information, which is the essential property between nodes. Therefore, SESIM deepens the understanding of models for graph structure. At last, we train primary task and pretext tasks jointly, and use meta-learning to balance the contribution of pretext tasks for primary task. Empirical results validate the performance of SESIM method and demonstrate that this method can improve the representation ability of traditional neural networks on link prediction task and node classification task.