Interpolating between Optimal Transport and KL regularized Optimal Transport using R\'enyi Divergences

TL;DR

This paper introduces a new family of regularized optimal transport methods using Renyi divergences, which interpolate between unregularized and KL-regularized OT, offering improved stability and performance.

Contribution

It proposes Renyi divergence-based regularization for OT, providing a flexible interpolation between unregularized and KL-regularized OT with convergence guarantees.

Findings

Renyi regularized OT outperforms KL and Tsallis regularized OT in experiments.

The method better approximates unregularized OT plans.

It improves inference tasks by recovering ground truth more accurately.

Abstract

Regularized optimal transport (OT) has received much attention in recent years starting from Cuturi's introduction of Kullback-Leibler (KL) divergence regularized OT. In this paper, we propose regularizing the OT problem using the family of $\alpha$-R\'enyi divergences for $\alpha \in (0, 1)$. R\'enyi divergences are neither $f$-divergences nor Bregman distances, but they recover the KL divergence in the limit $\alpha \nearrow 1$. The advantage of introducing the additional parameter $\alpha$ is that for $\alpha \searrow 0$ we obtain convergence to the unregularized OT problem. For the KL regularized OT problem, this was achieved by letting the regularization parameter $\varepsilon$ tend to zero, which causes numerical instabilities. We present two different ways to obtain premetrics on probability measures, namely by R\'enyi divergence constraints and by penalization. The latter premetric interpolates between the unregularized and the KL regularized OT problem with weak convergence of the unique minimizer, generalizing the interpolation property of KL regularized OT. We use a nested mirror descent algorithm to solve the primal formulation. Both on real and synthetic data sets R\'enyi regularized OT plans outperform their KL and Tsallis counterparts in terms of being closer to the unregularized transport plans and recovering the ground truth in inference tasks better.