Have it your way: Individualized Privacy Assignment for DP-SGD
Franziska Boenisch, Christopher M\"uhl, Adam Dziedzic, Roy Rinberg,, Nicolas Papernot

TL;DR
This paper introduces Individualized DP-SGD, a variant of the standard differential privacy training method that allows for personalized privacy budgets, improving the privacy-utility balance by accommodating diverse user privacy preferences.
Contribution
It proposes a novel modification to DP-SGD enabling individualized privacy budgets, enhancing privacy guarantees tailored to each user's preferences.
Findings
Empirically improves privacy-utility trade-offs.
Supports personalized privacy preferences.
Modifies data sampling and gradient noising mechanisms.
Abstract
When training a machine learning model with differential privacy, one sets a privacy budget. This budget represents a maximal privacy violation that any user is willing to face by contributing their data to the training set. We argue that this approach is limited because different users may have different privacy expectations. Thus, setting a uniform privacy budget across all points may be overly conservative for some users or, conversely, not sufficiently protective for others. In this paper, we capture these preferences through individualized privacy budgets. To demonstrate their practicality, we introduce a variant of Differentially Private Stochastic Gradient Descent (DP-SGD) which supports such individualized budgets. DP-SGD is the canonical approach to training models with differential privacy. We modify its data sampling and gradient noising mechanisms to arrive at our approach,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
Taxonomy
TopicsPrivacy-Preserving Technologies in Data · Advanced Causal Inference Techniques
