Temporal Graph Benchmark for Machine Learning on Temporal Graphs
Shenyang Huang, Farimah Poursafaei, Jacob Danovitch, Matthias Fey,, Weihua Hu, Emanuele Rossi, Jure Leskovec, Michael Bronstein, Guillaume, Rabusseau, Reihaneh Rabbany

TL;DR
The paper introduces the Temporal Graph Benchmark (TGB), a comprehensive collection of large-scale, diverse datasets and evaluation protocols for advancing machine learning research on temporal graphs, highlighting variability in model performance and providing tools for reproducible experiments.
Contribution
The paper presents the TGB benchmark, including datasets, evaluation protocols, and an automated pipeline, facilitating standardized, reproducible research on temporal graph machine learning models.
Findings
Model performance varies significantly across datasets.
Simple methods often outperform complex models on dynamic node prediction.
TGB enables reproducible and accessible temporal graph research.
Abstract
We present the Temporal Graph Benchmark (TGB), a collection of challenging and diverse benchmark datasets for realistic, reproducible, and robust evaluation of machine learning models on temporal graphs. TGB datasets are of large scale, spanning years in duration, incorporate both node and edge-level prediction tasks and cover a diverse set of domains including social, trade, transaction, and transportation networks. For both tasks, we design evaluation protocols based on realistic use-cases. We extensively benchmark each dataset and find that the performance of common models can vary drastically across datasets. In addition, on dynamic node property prediction tasks, we show that simple methods often achieve superior performance compared to existing temporal graph models. We believe that these findings open up opportunities for future research on temporal graphs. Finally, TGB provides…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsAdvanced Graph Neural Networks · Data Quality and Management · Human Mobility and Location-Based Analysis
