Dissimilar Nodes Improve Graph Active Learning

TL;DR

This paper introduces dissimilarity-based scores for active learning in graph embedding, which consider the influence of labeled nodes on unlabeled node importance, improving classification accuracy.

Contribution

It proposes three novel dissimilarity scores that incorporate labeled node influence, enhancing active learning effectiveness for graph neural networks.

Findings

Dissimilarity scores improve classification accuracy by 2.1% on average.

Scores generalize across different GNN architectures.

Incorporating labeled node influence boosts active learning performance.

Abstract

Training labels for graph embedding algorithms could be costly to obtain in many practical scenarios. Active learning (AL) algorithms are very helpful to obtain the most useful labels for training while keeping the total number of label queries under a certain budget. The existing Active Graph Embedding framework proposes to use centrality score, density score, and entropy score to evaluate the value of unlabeled nodes, and it has been shown to be capable of bringing some improvement to the node classification tasks of Graph Convolutional Networks. However, when evaluating the importance of unlabeled nodes, it fails to consider the influence of existing labeled nodes on the value of unlabeled nodes. In other words, given the same unlabeled node, the computed informative score is always the same and is agnostic to the labeled node set. With the aim to address this limitation, in this work, we introduce 3 dissimilarity-based information scores for active learning: feature dissimilarity score (FDS), structure dissimilarity score (SDS), and embedding dissimilarity score (EDS). We find out that those three scores are able to take the influence of the labeled set on the value of unlabeled candidates into consideration, boosting our AL performance. According to experiments, our newly proposed scores boost the classification accuracy by 2.1% on average and are capable of generalizing to different Graph Neural Network architectures.