MYSTIKO : : Cloud-Mediated, Private, Federated Gradient Descent
K. R. Jayaram, Archit Verma, Ashish Verma, Gegi Thomas, Colin, Sutcher-Shepard

TL;DR
This paper introduces MYSTIKO, a cloud-mediated federated learning method that uses homomorphic encryption to enhance privacy without sacrificing model accuracy or requiring complex hyperparameter tuning.
Contribution
It proposes a secure federated gradient descent approach using Paillier encryption that preserves accuracy, minimizes trust, and reduces overhead without adding noise.
Findings
Achieves privacy without accuracy loss
Eliminates need for hyperparameter tuning
Maintains efficiency and low overhead
Abstract
Federated learning enables multiple, distributed participants (potentially on different clouds) to collaborate and train machine/deep learning models by sharing parameters/gradients. However, sharing gradients, instead of centralizing data, may not be as private as one would expect. Reverse engineering attacks on plaintext gradients have been demonstrated to be practically feasible. Existing solutions for differentially private federated learning, while promising, lead to less accurate models and require nontrivial hyperparameter tuning. In this paper, we examine the use of additive homomorphic encryption (specifically the Paillier cipher) to design secure federated gradient descent techniques that (i) do not require addition of statistical noise or hyperparameter tuning, (ii) does not alter the final accuracy or utility of the final model, (iii) ensure that the plaintext model…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsPrivacy-Preserving Technologies in Data · Cryptography and Data Security · Stochastic Gradient Optimization Techniques
