A Sinkhorn-type Algorithm for Constrained Optimal Transport
Xun Tang, Holakou Rahmanian, Michael Shavlovsky, Kiran Koshy, Thekumparampil, Tesi Xiao, Lexing Ying

TL;DR
This paper introduces a Sinkhorn-type algorithm for solving constrained optimal transport problems with theoretical guarantees, including error bounds and convergence rates, enabling practical computation of transport plans under complex constraints.
Contribution
The work extends entropic optimal transport and Sinkhorn algorithms to handle combined equality and inequality constraints with proven convergence and error bounds.
Findings
Approximation error reduces exponentially with regularization parameter.
The proposed algorithm achieves sublinear convergence in the dual space.
Dynamic regularization and second-order acceleration improve convergence speed.
Abstract
Entropic optimal transport (OT) and the Sinkhorn algorithm have made it practical for machine learning practitioners to perform the fundamental task of calculating transport distance between statistical distributions. In this work, we focus on a general class of OT problems under a combination of equality and inequality constraints. We derive the corresponding entropy regularization formulation and introduce a Sinkhorn-type algorithm for such constrained OT problems supported by theoretical guarantees. We first bound the approximation error when solving the problem through entropic regularization, which reduces exponentially with the increase of the regularization parameter. Furthermore, we prove a sublinear first-order convergence rate of the proposed Sinkhorn-type algorithm in the dual space by characterizing the optimization procedure with a Lyapunov function. To achieve fast and…
Peer Reviews
Decision·Submitted to ICLR 2025
- This paper combines ideas from several previous works and extends them meaningfully in novel ways to solve constrained OT problems under both equality and inequality constraints. - The novelty lies in the use of Lyapunov function to characterize the optimization procedure to perform the constraint update dual step - Authors have presented convergence analysis of the proposed Sinkhorn-type optimization procedure with acceleration mechanisms - Authors have provided decent survey of related liter
- The numerical experiments are based on (weak) assumptions such as the cost matrix entries being sampled from uniform distribution in case of random assignment problem or the Rademacher distribution in case of Ranking under constraints (appendix A). It is not clear how the proposed algorithm performs when the cost matrix may not conform to simple distributions. - Authors could present experiments that would be more relevant to the target ML community. - Solving large scale problems would help
Constrained optimal transport may have various applications. IN ML it can be used e.g. for various domain adaptation scenarios with structured data. However, OT is a difficult problem to solve at scale. The Sinkhorn-type algorithms are widely believed to be a suitable way to address the difficulties with the exact OT problem. The paper pursues such a solution and the discussion is supported by rigorous mathematical results. The numerical results also reflect the superior convergence properties
I generally find the paper interesting, but have few concerns regarding the motivation of the problem, the justifications of the algorithmic choices and the implications of the theoretical results. These are mentioned as questions in the next part.
- The paper takes initial steps in the natural direction of OT problem research. - The theoretical results (such as the convergence rates and bounds) presented herein will likely be referenced in the foreseeable future. So, the results themselves are significant.
Firstly, the problem itself is not motivated well in the paper. The authors should consider working on the introduction to establish the relevance of this work better. Secondly, the only novelty I see is in Algorithm 1. However, I consider the theoretical contribution itself significant enough to overlook this shortcoming.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTransportation Planning and Optimization
MethodsFocus · Entropy Regularization
