FedGraph: A Research Library and Benchmark for Federated Graph Learning

TL;DR

FedGraph is a comprehensive library and benchmark platform for federated graph learning that emphasizes system performance, privacy, and scalability, supporting encrypted communication and large-scale graphs.

Contribution

Introduces FedGraph, a novel research library and benchmark for federated graph learning that integrates system performance evaluation, privacy-preserving encryption, and scalability features.

Findings

Supports scalable deployment on large graphs with 100 million nodes.

First to integrate encrypted low-rank communication in federated graph learning.

Demonstrates improved efficiency and privacy in federated graph training.

Abstract

Federated graph learning is an emerging field with significant practical challenges. While algorithms have been proposed to improve the accuracy of training graph neural networks, such as node classification on federated graphs, the system performance is often overlooked, despite it is crucial for real-world deployment. To bridge this gap, we introduce FedGraph, a research library designed for practical distributed training and comprehensive benchmarking of FGL algorithms. FedGraph supports a range of state-of-the-art graph learning methods and includes a monitoring class that evaluates system performance, with a particular focus on communication and computation costs during training. Unlike existing federated learning platforms, FedGraph natively integrates homomorphic encryption to enhance privacy preservation and supports scalable deployment across multiple physical machines with system-level performance evaluation to guide the system design of future algorithms. To enhance efficiency and privacy, we propose a low-rank communication scheme for algorithms like FedGCN that require pre-training communication, accelerating both the pre-training and training phases. Extensive experiments benchmark FGL algorithms on three major graph learning tasks and demonstrate FedGraph as the first efficient FGL framework to support encrypted low-rank communication and scale to graphs with 100 million nodes.