Certified Defense on the Fairness of Graph Neural Networks
Yushun Dong, Binchi Zhang, Hanghang Tong, Jundong Li

TL;DR
This paper introduces ELEGANT, a certifiable framework that guarantees the fairness of GNNs against input perturbations without retraining, enhancing trustworthiness in graph-based learning tasks.
Contribution
We propose ELEGANT, a universal, re-training-free certification framework for GNN fairness, applicable to any GNN architecture with theoretical guarantees.
Findings
ELEGANT successfully certifies fairness under specified perturbation budgets.
The framework is effective across various GNN backbones and datasets.
ELEGANT does not require assumptions on GNN structure or parameters.
Abstract
Graph Neural Networks (GNNs) have emerged as a prominent graph learning model in various graph-based tasks over the years. Nevertheless, due to the vulnerabilities of GNNs, it has been empirically shown that malicious attackers could easily corrupt the fairness level of their predictions by adding perturbations to the input graph data. In this paper, we take crucial steps to study a novel problem of certifiable defense on the fairness level of GNNs. Specifically, we propose a principled framework named ELEGANT and present a detailed theoretical certification analysis for the fairness of GNNs. ELEGANT takes {\em any} GNN as its backbone, and the fairness level of such a backbone is theoretically impossible to be corrupted under certain perturbation budgets for attackers. Notably, ELEGANT does not make any assumptions over the GNN structure or parameters, and does not require re-training…
Peer Reviews
Decision·Submitted to ICLR 2025
1. This work focuses on an important problem of fairness on graph-structured data. Many real-world applications such as financial analysis and social network analysis requires the fairness to be guaranteed. 2. The authors propose a novel problem of certified fairness defense to avoid the attacks on the fairness. 3. The analysis in certified fairness defense is solid. And surprisingly, the certified fairness method empirically improve the fairness.
Overall, the reviewer feel the strengths outweigh the weaknesses. However, several concerns would be highly suggested to be addressed. 1. The certified fairness defense is an application of certified robustness by changing the accuracy metric to the fairness metric in the analysis. This is quite straightforward. Hence, the contributions in theoretical analysis is somewhat limited. 2. For certified robustness methods, they improve the robustness because of the adversarial training stage of the tr
- The authors provide comprehensive experimental validation across multiple real-world datasets, demonstrating the generalizability and effectiveness of ELEGANT across different GNN architectures. - The paper is well-written, with clear explanations of the methodology and experimental setup.
- The setting, though well-defined theoretically, may lack practical applicability in real-world scenarios. The assumptions about the perturbation budgets and fairness certification requirements may not always align with practical needs, which could limit the framework’s deployment in real-life applications. The practical feasibility of maintaining certified fairness under realistic conditions could be further substantiated. - The Monte Carlo estimation and probabilistic guarantee calculation in
- Paper is well-written and fluent. - The considered research problem is a novel and important one. - The paper provides theoretical guarantees for fairness certification.
- The analysis in this paper is developed on existing randomized smoothing works, where certified evaluation has already been studied for both discrete and continuous data. This paper combines such works and reframes the problem from fairness aspect, which I believe limits its novelty in terms of analysis strategy. - As also explained in the paper, fairness improvements observed in the Experimental Results and Conclusions are probably just a by-product of the applied noise, thus there is not of
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Graph Neural Networks · Adversarial Robustness in Machine Learning · Ethics and Social Impacts of AI
