Privacy-Preserving Distributed Learning in IoT Systems: A Unified Threat Model and Evaluation Framework

TL;DR

This paper introduces a unified threat model and evaluation framework for privacy-preserving distributed learning in IoT, analyzing various techniques and highlighting the privacy-efficiency trade-offs.

Contribution

It provides a structured analysis and comparison framework for privacy-preserving methods in IoT distributed learning, unifying diverse approaches under realistic threat models.

Findings

Bloom Filter-based methods offer lightweight privacy with low overhead.

A fundamental trade-off exists between privacy robustness and system efficiency.

The framework enables comprehensive comparison of privacy techniques in IoT environments.

Abstract

The increasing deployment of Internet-of-Things (IoT) devices has accelerated the use of distributed learning frameworks, where data remains local while model updates are shared across decentralized systems. Although this reduces centralized data collection, it introduces privacy risks through the exchange of gradients, model parameters, and intermediate representations. A variety of privacy-preserving techniques have been proposed to address these risks, including differential privacy, cryptographic methods, and lightweight system-level approaches. However, existing surveys often evaluate these methods in isolation and lack a unified framework for comparing their effectiveness under realistic attack models and IoT resource constraints. This paper presents a structured analysis of privacy-preserving techniques for distributed learning in IoT environments. A unified threat model is introduced that captures model inversion, membership inference, gradient leakage, and communication-based attacks. Building on this model, an evaluation framework is developed to compare methods in terms of both privacy robustness and system-level efficiency, including computational, memory, and communication overhead. Using this framework, representative approaches including differential privacy, homomorphic encryption, secure multi-party computation, distributed selective stochastic gradient descent, and Bloom Filter-based methods are analyzed. The results highlight a fundamental trade-off between privacy strength and system efficiency. In particular, Bloom Filter-based encodings are shown to provide lightweight privacy through collision-induced ambiguity while maintaining low computational and communication overhead. The paper provides a unified perspective on privacy-preserving design choices for distributed learning in IoT systems.