Private Lossless Multiple Release

TL;DR

This paper introduces a framework for lossless multiple releases in differential privacy, enabling sequential releases with arbitrary privacy parameters while maintaining optimal privacy guarantees, applicable to Gaussian, Laplace, and Poisson mechanisms.

Contribution

It generalizes gradual release to a multiple release setting, providing lossless mechanisms for various noise distributions and efficient methods for sparse histograms.

Findings

Lossless multiple release is achievable for a broad class of mechanisms.

The Gaussian mechanism can be used with a simple, self-contained lossless release method.

Efficient release of sparse histograms with dimension-independent runtime.

Abstract

Koufogiannis et al. (2016) showed a $\textit{gradual release}$ result for Laplace noise-based differentially private mechanisms: given an $\varepsilon$-DP release, a new release with privacy parameter $\varepsilon' > \varepsilon$ can be computed such that the combined privacy loss of both releases is at most $\varepsilon'$ and the distribution of the latter is the same as a single release with parameter $\varepsilon'$. They also showed gradual release techniques for Gaussian noise, later also explored by Whitehouse et al. (2022). In this paper, we consider a more general $\textit{multiple release}$ setting in which analysts hold private releases with different privacy parameters corresponding to different access/trust levels. These releases are determined one by one, with privacy parameters in arbitrary order. A multiple release is $\textit{lossless}$ if having access to a subset $S$ of the releases has the same privacy guarantee as the least private release in $S$, and each release has the same distribution as a single release with the same privacy parameter. Our main result is that lossless multiple release is possible for a large class of additive noise mechanisms. For the Gaussian mechanism we give a simple method for lossless multiple release with a short, self-contained analysis that does not require knowledge of the mathematics of Brownian motion. We also present lossless multiple release for the Laplace and Poisson mechanisms. Finally, we consider how to efficiently do gradual release of sparse histograms, and present a mechanism with running time independent of the number of dimensions.