Convergence Theory of Generalized Distributed Subgradient Method with Random Quantization

TL;DR

This paper introduces a generalized distributed subgradient method with random quantization to address communication constraints in distributed optimization, providing convergence guarantees and bounds under quantization effects.

Contribution

It extends existing convergence analysis of DSG to include random quantization, offering a comprehensive theoretical framework and bounds for practical noisy communication scenarios.

Findings

Convergence is guaranteed under random quantization.

Upper bounds on convergence rates depend on quantization bits and network size.

Numerical simulations validate theoretical convergence bounds.

Abstract

The distributed subgradient method (DSG) is a widely discussed algorithm to cope with large-scale distributed optimization problems in the arising machine learning applications. Most exisiting works on DSG focus on ideal communication between the cooperative agents such that the shared information between agents is exact and perfect. This assumption, however, could lead to potential privacy concerns and is not feasible when the wireless transmission links are not of good quality. To overcome the challenge, a common approach is to quantize the data locally before transmission, which avoids exposure of raw data and significantly reduces the size of data. Compared with perfect data, quantization poses fundamental challenges on loss of data accuracy, which further impacts the convergence of the algorithms. To settle the problem, we propose a generalized distributed subgradient method with random quantization, which can be intepreted as a two time-scale stochastic approximation method. We provide comprehensive results on the convergence of the algorithm and derive upper bounds on the convergence rates in terms of the quantization bit, stepsizes and the number of network agents. Our results extend the existing results, where only special cases are considered and general conclusions for the convergence rates are missing. Finally, numerical simulations are conducted on linear regression problems to support our theoretical results.