Building upon score-based learning, new interest in stochastic localization techniques has recently emerged. In these models, one seeks to noise a sample from the data distribution through a stochastic process, called observation process, and progressively learns a denoiser associated to this dynamics. Apart from specific applications, the use of stochastic localization for the problem of sampling from an unnormalized target density has not been explored extensively. This work contributes to fill this gap. We consider a general stochastic localization framework and introduce an explicit class of observation processes, associated with flexible denoising schedules. We provide a complete methodology, $\textit{Stochastic Localization via Iterative Posterior Sampling}$ (SLIPS), to obtain approximate samples of this dynamics, and as a by-product, samples from the target distribution. Our scheme is based on a Markov chain Monte Carlo estimation of the denoiser and comes with detailed practical guidelines. We illustrate the benefits and applicability of SLIPS on several benchmarks, including Gaussian mixtures in increasing dimensions, Bayesian logistic regression and a high-dimensional field system from statistical-mechanics.
翻译:在基于分数学习的基础上,随机定位技术近期引起了新的研究兴趣。在这类模型中,我们试图通过一个称为观测过程的随机过程对数据分布中的样本添加噪声,并逐步学习与该动力学相关的去噪器。除了特定应用外,随机定位在从非归一化目标密度中进行采样问题上的应用尚未得到广泛探索。本研究旨在填补这一空白。我们考虑一个通用的随机定位框架,并引入一类与灵活去噪调度相关的显式观测过程。我们提出了完整的方法论——$\textit{基于迭代后验采样的随机定位}$(SLIPS),以获取该动力学的近似样本,并作为副产品获得目标分布中的样本。该方案基于马尔可夫链蒙特卡洛估计去噪器,并附有详细的实践指南。我们在多个基准测试中展示了SLIPS的优势和适用性,包括维数递增的高斯混合模型、贝叶斯逻辑回归以及统计力学中的高维场系统。