Secure and Confidential Certificates of Online Fairness
Olive Franzese, Ali Shahin Shamsabadi, Carter Luck, Hamed Haddadi

TL;DR
This paper introduces online fairness certificates and OATH, a scalable zero-knowledge proof protocol, to verify ML model fairness confidentially during deployment, addressing reliability and scalability issues.
Contribution
The paper proposes the first online fairness certification method and a scalable zero-knowledge protocol, OATH, for confidential, real-time fairness verification of ML models.
Findings
OATH achieves improved scalability over existing methods.
The protocol reliably certifies fairness during deployment.
It maintains confidentiality while verifying fairness in real-time.
Abstract
The black-box service model enables ML service providers to serve clients while keeping their intellectual property and client data confidential. Confidentiality is critical for delivering ML services legally and responsibly, but makes it difficult for outside parties to verify important model properties such as fairness. Existing methods that assess model fairness confidentially lack either (i) reliability because they certify fairness with respect to a static set of data, and therefore fail to guarantee fairness in the presence of distribution shift or service provider malfeasance; and/or (ii) scalability due to the computational overhead of confidentiality-preserving cryptographic primitives. We address these problems by introducing online fairness certificates, which verify that a model is fair with respect to data received by the service provider online during deployment. We then…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
Taxonomy
TopicsAdversarial Robustness in Machine Learning · Cryptography and Data Security · Privacy-Preserving Technologies in Data
Methodstravel james
