Reduced Network Cumulative Constraint Violation for Distributed Bandit Convex Optimization under Slater Condition

TL;DR

This paper introduces a novel distributed bandit convex optimization algorithm that effectively reduces network cumulative constraint violation under Slater condition, improving regret and violation bounds in time-varying constrained environments.

Contribution

The paper proposes a new distributed bandit primal-dual algorithm that achieves reduced cumulative constraint violation bounds under Slater condition, a novel contribution in this domain.

Findings

Establishes sublinear network regret and constraint violation bounds.

Reduces network cumulative constraint violation when Slater condition holds.

Improves regret bounds when local loss functions are strongly convex.

Abstract

This paper studies the distributed bandit convex optimization problem with time-varying inequality constraints, where the goal is to minimize network regret and cumulative constraint violation. To calculate network cumulative constraint violation, existing distributed bandit online algorithms solving this problem directly use the clipped constraint function to replace its original constraint function. However, the use of the clipping operation renders Slater condition (i.e, there exists a point that strictly satisfies the inequality constraints at all iterations) ineffective to achieve reduced network cumulative constraint violation. To tackle this challenge, we propose a new distributed bandit online primal-dual algorithm. If local loss functions are convex, we show that the proposed algorithm establishes sublinear network regret and cumulative constraint violation bounds. When Slater condition holds, the network cumulative constraint violation bound is reduced. In addition, if local loss functions are strongly convex, for the case where strongly convex parameters are unknown, the network regret bound is reduced. For the case where strongly convex parameters are known, the network regret and cumulative constraint violation bounds are further reduced. To the best of our knowledge, this paper is among the first to establish reduced (network) cumulative constraint violation bounds for (distributed) bandit convex optimization with time-varying constraints under Slater condition. Finally, a numerical example is provided to verify the theoretical results.