DiffGraph: Heterogeneous Graph Diffusion Model

TL;DR

DiffGraph introduces a novel diffusion-based framework for heterogeneous graphs that effectively denoises data and captures complex semantic relations, leading to improved performance in link prediction and node classification tasks.

Contribution

It presents a pioneering latent heterogeneous graph diffusion model with a cross-view denoising strategy, advancing robustness and efficiency in heterogeneous graph learning.

Findings

Outperforms existing methods in link prediction.

Achieves superior node classification accuracy.

Establishes new benchmarks on multiple datasets.

Abstract

Recent advances in Graph Neural Networks (GNNs) have revolutionized graph-structured data modeling, yet traditional GNNs struggle with complex heterogeneous structures prevalent in real-world scenarios. Despite progress in handling heterogeneous interactions, two fundamental challenges persist: noisy data significantly compromising embedding quality and learning performance, and existing methods' inability to capture intricate semantic transitions among heterogeneous relations, which impacts downstream predictions. To address these fundamental issues, we present the Heterogeneous Graph Diffusion Model (DiffGraph), a pioneering framework that introduces an innovative cross-view denoising strategy. This advanced approach transforms auxiliary heterogeneous data into target semantic spaces, enabling precise distillation of task-relevant information. At its core, DiffGraph features a sophisticated latent heterogeneous graph diffusion mechanism, implementing a novel forward and backward diffusion process for superior noise management. This methodology achieves simultaneous heterogeneous graph denoising and cross-type transition, while significantly simplifying graph generation through its latent-space diffusion capabilities. Through rigorous experimental validation on both public and industrial datasets, we demonstrate that DiffGraph consistently surpasses existing methods in link prediction and node classification tasks, establishing new benchmarks for robustness and efficiency in heterogeneous graph processing. The model implementation is publicly available at: https://github.com/HKUDS/DiffGraph.