Overpredictive Signal Analytics in Federated Learning: Algorithms and Analysis

TL;DR

This paper introduces algorithms for overpredictive signal approximation in federated learning, balancing communication efficiency and accuracy, with theoretical analysis and empirical validation on energy data.

Contribution

It proposes convex optimization algorithms for overpredictive signal approximations in federated learning, addressing privacy and communication constraints.

Findings

Algorithms effectively compute overpredictive signal approximations.

Tradeoffs between communication, sampling, and error are mathematically characterized.

Empirical results demonstrate practical performance on energy consumption data.

Abstract

Edge signal processing facilitates distributed learning and inference in the client-server model proposed in federated learning. In traditional machine learning, clients (IoT devices) that acquire raw signal samples can aid a data center (server) learn a global signal model by pooling these distributed samples at a third-party location. Despite the promising capabilities of IoTs, these distributed deployments often face the challenge of sensitive private data and communication rate constraints. This necessitates a learning approach that communicates a processed approximation of the distributed samples instead of the raw signals. Such a decentralized learning approach using signal approximations will be termed distributed signal analytics in this work. Overpredictive signal approximations may be desired for distributed signal analytics, especially in network demand (capacity) planning applications motivated by federated learning. In this work, we propose algorithms that compute an overpredictive signal approximation at the client devices using an efficient convex optimization framework. Tradeoffs between communication cost, sampling rate, and the signal approximation error are quantified using mathematical analysis. We also show the performance of the proposed distributed algorithms on a publicly available residential energy consumption dataset.