Computational optimal transport (OT) has recently emerged as a powerful framework with applications in various fields. In this paper we focus on a relaxation of the original OT problem, the entropic OT problem, which allows to implement efficient and practical algorithmic solutions, even in high dimensional settings. This formulation, also known as the Schr\"odinger Bridge problem, notably connects with Stochastic Optimal Control (SOC) and can be solved with the popular Sinkhorn algorithm. In the case of discrete-state spaces, this algorithm is known to have exponential convergence; however, achieving a similar rate of convergence in a more general setting is still an active area of research. In this work, we analyze the convergence of the Sinkhorn algorithm for probability measures defined on the $d$-dimensional torus $\mathbb{T}_L^d$, that admit densities with respect to the Haar measure of $\mathbb{T}_L^d$. In particular, we prove pointwise exponential convergence of Sinkhorn iterates and their gradient. Our proof relies on the connection between these iterates and the evolution along the Hamilton-Jacobi-Bellman equations of value functions obtained from SOC-problems. Our approach is novel in that it is purely probabilistic and relies on coupling by reflection techniques for controlled diffusions on the torus.
翻译:计算最优传输(OT)近期已发展为一个强大框架,广泛应用于多个领域。本文聚焦于原始OT问题的松弛形式——熵正则化OT问题,该问题允许在高维场景中实现高效实用的算法解决方案。这一公式也称为薛定谔桥问题,与随机最优控制(SOC)存在显著关联,并可通过流行的Sinkhorn算法求解。在离散状态空间情形下,该算法已被证明具有指数收敛性;然而,在更一般设定中实现类似收敛速率仍是活跃的研究领域。本文针对定义在$d$维环面$\mathbb{T}_L^d$上、且关于$\mathbb{T}_L^d$上Haar测度存在密度的概率测度,分析了Sinkhorn算法的收敛性。我们特别证明了Sinkhorn迭代及其梯度的逐点指数收敛。该证明依赖于这些迭代与SOC问题所得值函数沿Hamilton-Jacobi-Bellman方程的演化之间的关联。本方法具有纯概率性质,其新颖之处在于采用环面受控扩散的反射耦合技术。