FedX: Explanation-Guided Pruning for Communication-Efficient Federated Learning in Remote Sensing

TL;DR

FedX introduces an explanation-guided pruning method for federated learning in remote sensing, significantly reducing communication costs while maintaining or improving model performance.

Contribution

It proposes a novel explanation-guided pruning strategy that minimizes model size in federated learning for remote sensing, enhancing efficiency without sacrificing accuracy.

Findings

Substantial reduction in model parameters transmitted.

Improved generalization of the global model.

Outperforms existing pruning methods in FL settings.

Abstract

Federated learning (FL) enables the collaborative training of deep neural networks across decentralized data archives (i.e., clients), where each client stores data locally and only shares model updates with a central server. This makes FL a suitable learning paradigm for remote sensing (RS) image classification tasks, where data centralization may be restricted due to legal and privacy constraints. However, a key challenge in applying FL to RS tasks is the communication overhead caused by the frequent exchange of large model updates between clients and the central server. To address this issue, in this paper we propose a novel strategy (denoted as FedX) that uses explanation-guided pruning to reduce communication overhead by minimizing the size of the transmitted models without compromising performance. FedX leverages backpropagation-based explanation methods to estimate the task-specific importance of model components and prunes the least relevant ones at the central server. The resulting sparse global model is then sent to clients, substantially reducing communication overhead. We evaluate FedX on multi-label scene classification using the BigEarthNet-S2 dataset and single-label scene classification using the EuroSAT dataset. Experimental results show the success of FedX in significantly reducing the number of shared model parameters while enhancing the generalization capability of the global model, compared to both unpruned model and state-of-the-art pruning methods. The code of FedX will be available at https://git.tu-berlin.de/rsim/FedX.