Noise-Resilient Unsupervised Graph Representation Learning via Multi-Hop Feature Quality Estimation

TL;DR

This paper introduces a noise-resilient unsupervised graph representation learning method called MQE, which estimates feature quality across multiple hops to improve robustness against noisy node features in real-world data.

Contribution

The paper proposes a novel multi-hop feature quality estimation approach that enhances unsupervised graph learning by effectively handling noisy node features.

Findings

MQE improves representation quality in noisy scenarios

The method outperforms existing UGRL models on real-world datasets

Feature quality estimation reduces noise impact on learned embeddings

Abstract

Unsupervised graph representation learning (UGRL) based on graph neural networks (GNNs), has received increasing attention owing to its efficacy in handling graph-structured data. However, existing UGRL methods ideally assume that the node features are noise-free, which makes them fail to distinguish between useful information and noise when applied to real data with noisy features, thus affecting the quality of learned representations. This urges us to take node noisy features into account in real-world UGRL. With empirical analysis, we reveal that feature propagation, the essential operation in GNNs, acts as a "double-edged sword" in handling noisy features - it can both denoise and diffuse noise, leading to varying feature quality across nodes, even within the same node at different hops. Building on this insight, we propose a novel UGRL method based on Multi-hop feature Quality Estimation (MQE for short). Unlike most UGRL models that directly utilize propagation-based GNNs to generate representations, our approach aims to learn representations through estimating the quality of propagated features at different hops. Specifically, we introduce a Gaussian model that utilizes a learnable "meta-representation" as a condition to estimate the expectation and variance of multi-hop propagated features via neural networks. In this way, the "meta representation" captures the semantic and structural information underlying multiple propagated features but is naturally less susceptible to interference by noise, thereby serving as high-quality node representations beneficial for downstream tasks. Extensive experiments on multiple real-world datasets demonstrate that MQE in learning reliable node representations in scenarios with diverse types of feature noise.