ProbSelect: Stochastic Client Selection for GPU-Accelerated Compute Devices in the 3D Continuum

TL;DR

ProbSelect is a new probabilistic client selection method for federated learning on GPU devices in a 3D continuum, improving service level compliance and reducing computational waste without relying on historical data.

Contribution

It introduces an analytical and probabilistic approach for client selection that handles dynamic environments and GPU-specific training characteristics, unlike prior CPU-focused methods.

Findings

Improves SLO compliance by 13.77% on average.

Reduces computational waste by 72.5%.

Effective across diverse GPU architectures and workloads.

Abstract

Integration of edge, cloud and space devices into a unified 3D continuum imposes significant challenges for client selection in federated learning systems. Traditional approaches rely on continuous monitoring and historical data collection, which becomes impractical in dynamic environments where satellites and mobile devices frequently change operational conditions. Furthermore, existing solutions primarily consider CPU-based computation, failing to capture complex characteristics of GPU-accelerated training that is prevalent across the 3D continuum. This paper introduces ProbSelect, a novel approach utilizing analytical modeling and probabilistic forecasting for client selection on GPU-accelerated devices, without requiring historical data or continuous monitoring. We model client selection within user-defined SLOs. Extensive evaluation across diverse GPU architectures and workloads demonstrates that ProbSelect improves SLO compliance by 13.77% on average while achieving 72.5% computational waste reduction compared to baseline approaches.