An Enhanced Privacy-preserving Federated Few-shot Learning Framework for Respiratory Disease Diagnosis

TL;DR

This paper introduces a privacy-preserving federated few-shot learning framework with meta-learning and differential privacy for respiratory disease diagnosis, effectively addressing data scarcity and privacy concerns across multiple medical institutions.

Contribution

It proposes a novel federated few-shot learning approach incorporating meta-stochastic gradient descent and differential privacy to enhance diagnosis accuracy while protecting patient data.

Findings

Effective respiratory disease diagnosis across diverse datasets

Maintains data privacy with differential privacy noise addition

Improves model generalization with meta-stochastic gradient descent

Abstract

The labor-intensive nature of medical data annotation presents a significant challenge for respiratory disease diagnosis, resulting in a scarcity of high-quality labeled datasets in resource-constrained settings. Moreover, patient privacy concerns complicate the direct sharing of local medical data across institutions, and existing centralized data-driven approaches, which rely on amounts of available data, often compromise data privacy. This study proposes a federated few-shot learning framework with privacy-preserving mechanisms to address the issues of limited labeled data and privacy protection in diagnosing respiratory diseases. In particular, a meta-stochastic gradient descent algorithm is proposed to mitigate the overfitting problem that arises from insufficient data when employing traditional gradient descent methods for neural network training. Furthermore, to ensure data privacy against gradient leakage, differential privacy noise from a standard Gaussian distribution is integrated into the gradients during the training of private models with local data, thereby preventing the reconstruction of medical images. Given the impracticality of centralizing respiratory disease data dispersed across various medical institutions, a weighted average algorithm is employed to aggregate local diagnostic models from different clients, enhancing the adaptability of a model across diverse scenarios. Experimental results show that the proposed method yields compelling results with the implementation of differential privacy, while effectively diagnosing respiratory diseases using data from different structures, categories, and distributions.