Residual Reweighted Conformal Prediction for Graph Neural Networks

TL;DR

This paper introduces RR-GNN, a novel framework that enhances conformal prediction for graph neural networks by accounting for graph heterogeneity, reducing over-conservativeness, and providing reliable, minimal prediction sets with coverage guarantees.

Contribution

RR-GNN integrates graph-structured partitioning, residual-adaptive scoring, and cross-training to improve prediction intervals in GNNs, addressing limitations of existing conformal prediction methods.

Findings

Achieves improved efficiency over state-of-the-art methods.

Maintains provable marginal coverage guarantees.

Validated on 15 real-world graph datasets.

Abstract

Graph Neural Networks (GNNs) excel at modeling relational data but face significant challenges in high-stakes domains due to unquantified uncertainty. Conformal prediction (CP) offers statistical coverage guarantees, but existing methods often produce overly conservative prediction intervals that fail to account for graph heteroscedasticity and structural biases. While residual reweighting CP variants address some of these limitations, they neglect graph topology, cluster-specific uncertainties, and risk data leakage by reusing training sets. To address these issues, we propose Residual Reweighted GNN (RR-GNN), a framework designed to generate minimal prediction sets with provable marginal coverage guarantees. RR-GNN introduces three major innovations to enhance prediction performance. First, it employs Graph-Structured Mondrian CP to partition nodes or edges into communities based on topological features, ensuring cluster-conditional coverage that reflects heterogeneity. Second, it uses Residual-Adaptive Nonconformity Scores by training a secondary GNN on a held-out calibration set to estimate task-specific residuals, dynamically adjusting prediction intervals according to node or edge uncertainty. Third, it adopts a Cross-Training Protocol, which alternates the optimization of the primary GNN and the residual predictor to prevent information leakage while maintaining graph dependencies. We validate RR-GNN on 15 real-world graphs across diverse tasks, including node classification, regression, and edge weight prediction. Compared to CP baselines, RR-GNN achieves improved efficiency over state-of-the-art methods, with no loss of coverage.