A Distributed Algorithm for Online Convex Optimization with Time-Varying Coupled Inequality Constraints

Abstract

This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the sum of local convex constraint functions. A distributed online primal-dual mirror descent algorithm is proposed to solve this problem, where the local cost, regularization, and constraint functions are held privately and revealed only after each time slot. We first derive regret and constraint violation bounds for the algorithm and show how they depend on the stepsize sequences, the accumulated variation of the comparator sequence, the number of agents, and the network connectivity. As a result, we prove that the algorithm achieves sublinear dynamic regret and constraint violation if the accumulated variation of the optimal sequence also grows sublinearly. We also prove that the algorithm achieves sublinear static regret and constraint violation under mild conditions. In addition, smaller bounds on the static regret are achieved when the objective functions are strongly convex. Finally, numerical simulations are provided to illustrate the effectiveness of the theoretical results.