We present a tensor train (TT) based algorithm designed for sampling from a target distribution and employ TT approximation to capture the high-dimensional probability density evolution of overdamped Langevin dynamics. This involves utilizing the regularized Wasserstein proximal operator, which exhibits a simple kernel integration formulation, i.e., the softmax formula of the traditional proximal operator. The integration, performed in $\mathbb{R}^d$, poses a challenge in practical scenarios, making the algorithm practically implementable only with the aid of TT approximation. In the specific context of Gaussian distributions, we rigorously establish the unbiasedness and linear convergence of our sampling algorithm towards the target distribution. To assess the effectiveness of our proposed methods, we apply them to various scenarios, including Gaussian families, Gaussian mixtures, bimodal distributions, and Bayesian inverse problems in numerical examples. The sampling algorithm exhibits superior accuracy and faster convergence when compared to classical Langevin dynamics-type sampling algorithms.
翻译:我们提出一种基于张量列(TT)的采样算法,用于从目标分布中采样,并利用TT近似捕捉过阻尼朗之万动力学的高维概率密度演化过程。该方法涉及正则化Wasserstein近端算子,该算子具有简单的核积分表达形式,即传统近端算子的softmax公式。该积分在$\mathbb{R}^d$空间中进行,给实际应用带来了挑战,使得该算法唯有借助TT近似方能实现。在特定高斯分布场景下,我们严格证明了采样算法对目标分布的无偏性与线性收敛性。为评估所提方法的有效性,我们在数值实验中将其应用于高斯族、高斯混合模型、双峰分布及贝叶斯反问题等多种场景。与经典朗之万动力学类型采样算法相比,该算法展现出更优的精度与更快的收敛速度。