Adaptive Dual Prompting: Hierarchical Debiasing for Fairness-aware Graph Neural Networks

TL;DR

This paper introduces ADPrompt, a novel framework that improves fairness in pre-trained GNNs by using adaptive prompts to mitigate attribute bias and calibrate message passing, leading to better fair node classification.

Contribution

The paper proposes a dual prompting approach with adaptive modules to enhance fairness in pre-trained GNNs, addressing bias mitigation and dynamic message calibration.

Findings

ADPrompt outperforms baseline methods on node classification tasks.

The adaptive modules effectively reduce attribute bias and improve fairness.

Experimental results across multiple datasets validate the approach's effectiveness.

Abstract

In recent years, pre-training Graph Neural Networks (GNNs) through self-supervised learning on unlabeled graph data has emerged as a widely adopted paradigm in graph learning. Although the paradigm is effective for pre-training powerful GNN models, the objective gap often exists between pre-training and downstream tasks. To bridge this gap, graph prompting adapts pre-trained GNN models to specific downstream tasks with extra learnable prompts while keeping the pre-trained GNN models frozen. As recent graph prompting methods largely focus on enhancing model utility on downstream tasks, they often overlook fairness concerns when designing prompts for adaptation. In fact, pre-trained GNN models will produce discriminative node representations across demographic subgroups, as downstream graph data inherently contains biases in both node attributes and graph structures. To address this issue, we propose an Adaptive Dual Prompting (ADPrompt) framework that enhances fairness for adapting pre-trained GNN models to downstream tasks. To mitigate attribute bias, we design an Adaptive Feature Rectification module that learns customized attribute prompts to suppress sensitive information at the input layer, reducing bias at the source. Afterward, we propose an Adaptive Message Calibration module that generates structure prompts at each layer, which adjust the message from neighboring nodes to enable dynamic and soft calibration of the information flow. Finally, ADPrompt jointly optimizes the two prompting modules to adapt the pre-trained GNN while enhancing fairness. We conduct extensive experiments on four datasets with four pre-training strategies to evaluate the performance of ADPrompt. The results demonstrate that our proposed ADPrompt outperforms seven baseline methods on node classification tasks.