The Coordinate Ascent Variational Inference scheme is a popular algorithm used to compute the mean-field approximation of a probability distribution of interest. We analyze its random scan version, under log-concavity assumptions on the target density. Our approach builds on the recent work of M. Arnese and D. Lacker, \emph{Convergence of coordinate ascent variational inference for log-concave measures via optimal transport} [arXiv:2404.08792] which studies the deterministic scan version of the algorithm, phrasing it as a block-coordinate descent algorithm in the space of probability distributions endowed with the geometry of optimal transport. We obtain tight rates for the random scan version, which imply that the total number of factor updates required to converge scales linearly with the condition number and the number of blocks of the target distribution. By contrast, available bounds for the deterministic scan case scale quadratically in the same quantities, which is analogue to what happens for optimization of convex functions in Euclidean spaces.
翻译:坐标上升变分推断方案是一种用于计算目标概率分布平均场近似的流行算法。我们分析了其随机扫描版本在对数凹性假设下的性质。该方法基于M. Arnese与D. Lacker近期的工作《通过最优传输实现对数凹测度坐标上升变分推断的收敛性》[arXiv:2404.08792],该工作研究了算法的确定性扫描版本,并将其表述为在赋予最优传输几何结构的概率分布空间上的块坐标下降算法。我们获得了随机扫描版本的紧致收敛速率,表明达到收敛所需的因子更新总数与目标分布的条件数及分块数呈线性关系。相比之下,确定性扫描情况下的现有界在上述相同量上呈二次增长,这与欧几里得空间中凸函数优化的情形类似。