We study sampling problems associated with potentials that lack smoothness. The potentials can be either convex or non-convex. Departing from the standard smooth setting, the potentials are only assumed to be weakly smooth or non-smooth, or the summation of multiple such functions. We develop a sampling algorithm that resembles proximal algorithms in optimization for this challenging sampling task. Our algorithm is based on a special case of Gibbs sampling known as the alternating sampling framework (ASF). The key contribution of this work is a practical realization of the ASF based on rejection sampling for both non-convex and convex potentials that are not necessarily smooth. In almost all the cases of sampling considered in this work, our proximal sampling algorithm achieves better complexity than all existing methods.
翻译:我们研究了与缺乏光滑性的势函数相关的采样问题。这些势函数可以是凸函数或非凸函数。与标准光滑设定不同,我们仅假设势函数是弱光滑或非光滑的,或者是多个此类函数的和。我们针对这一具有挑战性的采样任务,开发了一种类似于优化中近端算法的采样算法。该算法基于吉布斯采样的一种特殊情况,即交替采样框架(ASF)。本文的关键贡献在于,针对不一定光滑的非凸和凸势函数,基于拒绝采样实现了ASF的实际应用。在本文所考虑的大多数采样案例中,我们的近端采样算法复杂度均优于所有现有方法。