Quantifying Membership Disclosure Risk for Tabular Synthetic Data Using Kernel Density Estimators

TL;DR

This paper introduces a KDE-based method to quantify membership inference risks in synthetic tabular data, providing a practical tool for privacy risk assessment without extensive computational costs.

Contribution

It presents a novel KDE-based approach for membership inference risk quantification that is more effective and practical than previous methods, especially for tabular synthetic data.

Findings

Outperforms prior baseline in F1 score and risk characterization

Works effectively across multiple real-world datasets and generators

Does not require shadow models for risk assessment

Abstract

The use of synthetic data has become increasingly popular as a privacy-preserving alternative to sharing real datasets, especially in sensitive domains such as healthcare, finance, and demography. However, the privacy assurances of synthetic data are not absolute, and remain susceptible to membership inference attacks (MIAs), where adversaries aim to determine whether a specific individual was present in the dataset used to train the generator. In this work, we propose a practical and effective method to quantify membership disclosure risk in tabular synthetic datasets using kernel density estimators (KDEs). Our KDE-based approach models the distribution of nearest-neighbour distances between synthetic data and the training records, allowing probabilistic inference of membership and enabling robust evaluation via ROC curves. We propose two attack models: a 'True Distribution Attack', which assumes privileged access to training data, and a more realistic, implementable 'Realistic Attack' that uses auxiliary data without true membership labels. Empirical evaluations across four real-world datasets and six synthetic data generators demonstrate that our method consistently achieves higher F1 scores and sharper risk characterization than a prior baseline approach, without requiring computationally expensive shadow models. The proposed method provides a practical framework and metric for quantifying membership disclosure risk in synthetic data, which enables data custodians to conduct a post-generation risk assessment prior to releasing their synthetic datasets for downstream use. The datasets and codes for this study are available at https://github.com/PyCoder913/MIA-KDE.