Federated Cross-Client Subgraph Pattern Detection

TL;DR

This paper introduces a federated learning framework for subgraph pattern detection that synchronizes intermediate node representations across distributed clients to match centralized GNN performance.

Contribution

It formalizes the structural observability problem in distributed GNNs and proposes a layer-wise embedding exchange method to recover full graph representations.

Findings

Embedding exchange and federated parameter aggregation are complementary.

Fresh per-step exchanged embeddings improve representation recovery.

The method achieves centralized GNN performance in a federated setting.

Abstract

Subgraph pattern detection aims to uncover complex interaction structures in graphs. However, state-of-the-art graph neural network (GNN)-based solutions assume centralized access to the entire graph. When graphs are instead distributed across multiple parties, client-local GNN computations diverge from those of a centralized model, resulting in a representation-equivalence gap. We formalize this as a structural observability problem, where subgraph patterns crossing partition boundaries become locally unidentifiable. To bridge this gap, we propose a per-step, layer-wise embedding exchange framework in which clients synchronize intermediate node representations at each layer of the forward pass, without exposing raw features or labels. Under an extended-subgraph assumption and shared model parameters across clients, this framework recovers the same node representations as a centralized GNN over the full graph. Experiments on synthetic directed multigraphs with cycles, bicliques, and scatter-gather patterns show that embedding exchange and federated parameter aggregation are complementary rather than interchangeable: their combination recovers most of the representation gap, provided exchanged embeddings are fresh per-step rather than stale per-epoch.