FedCure: Mitigating Participation Bias in Semi-Asynchronous Federated Learning with Non-IID Data

TL;DR

FedCure is a novel federated learning framework that reduces participation bias caused by non-IID data and hierarchical architectures through coalition-based scheduling and resource optimization, improving accuracy and efficiency.

Contribution

It introduces a coalition construction and participation-aware scheduling approach to mitigate participation bias in semi-asynchronous federated learning with non-IID data.

Findings

Achieves up to 5.1x accuracy improvement over baselines.

Reduces per-round latency variation to 0.0223 coefficient of variation.

Maintains long-term balance across diverse datasets.

Abstract

While semi-asynchronous federated learning (SAFL) combines the efficiency of synchronous training with the flexibility of asynchronous updates, it inherently suffers from participation bias, which is further exacerbated by non-IID data distributions. More importantly, hierarchical architecture shifts participation from individual clients to client groups, thereby further intensifying this issue. Despite notable advancements in SAFL research, most existing works still focus on conventional cloud-end architectures while largely overlooking the critical impact of non-IID data on scheduling across the cloud-edge-client hierarchy. To tackle these challenges, we propose FedCure, an innovative semi-asynchronous Federated learning framework that leverages coalition construction and participation-aware scheduling to mitigate participation bias with non-IID data. Specifically, FedCure operates through three key rules: (1) a preference rule that optimizes coalition formation by maximizing collective benefits and establishing theoretically stable partitions to reduce non-IID-induced performance degradation; (2) a scheduling rule that integrates the virtual queue technique with Bayesian-estimated coalition dynamics, mitigating efficiency loss while ensuring mean rate stability; and (3) a resource allocation rule that enhances computational efficiency by optimizing client CPU frequencies based on estimated coalition dynamics while satisfying delay requirements. Comprehensive experiments on four real-world datasets demonstrate that FedCure improves accuracy by up to 5.1x compared with four state-of-the-art baselines, while significantly enhancing efficiency with the lowest coefficient of variation 0.0223 for per-round latency and maintaining long-term balance across diverse scenarios.