PPGAN: Privacy-preserving Generative Adversarial Network

TL;DR

PPGAN introduces a differentially private GAN model that adds noise to gradients and uses Moments Accountant to generate high-quality synthetic data while protecting sensitive information.

Contribution

This work presents the first differential privacy GAN with a mathematical privacy proof and improved training stability using Moments Accountant.

Findings

PPGAN effectively balances data utility and privacy.

The model produces high-quality synthetic data under reasonable privacy budgets.

Extensive experiments validate the approach's effectiveness.

Abstract

Generative Adversarial Network (GAN) and its variants serve as a perfect representation of the data generation model, providing researchers with a large amount of high-quality generated data. They illustrate a promising direction for research with limited data availability. When GAN learns the semantic-rich data distribution from a dataset, the density of the generated distribution tends to concentrate on the training data. Due to the gradient parameters of the deep neural network contain the data distribution of the training samples, they can easily remember the training samples. When GAN is applied to private or sensitive data, for instance, patient medical records, as private information may be leakage. To address this issue, we propose a Privacy-preserving Generative Adversarial Network (PPGAN) model, in which we achieve differential privacy in GANs by adding well-designed noise to the gradient during the model learning procedure. Besides, we introduced the Moments Accountant strategy in the PPGAN training process to improve the stability and compatibility of the model by controlling privacy loss. We also give a mathematical proof of the differential privacy discriminator. Through extensive case studies of the benchmark datasets, we demonstrate that PPGAN can generate high-quality synthetic data while retaining the required data available under a reasonable privacy budget.