Metropolis-Hastings (MH) is a foundational Markov chain Monte Carlo (MCMC) algorithm. In this paper, we ask whether it is possible to formulate and analyse MH in terms of categorical probability, using a recent involutive framework for MH-type procedures as a concrete case study. We show how basic MCMC concepts such as invariance and reversibility can be formulated in Markov categories, and how one part of the MH kernel can be analysed using standard CD categories. To go further, we then study enrichments of CD categories over commutative monoids. This gives an expressive setting for reasoning abstractly about a range of important probabilistic concepts, including substochastic kernels, finite and $σ$-finite measures, absolute continuity, singular measures, and Lebesgue decompositions. Using these tools, we give synthetic necessary and sufficient conditions for a general MH-type sampler to be reversible with respect to a given target distribution.
翻译:Metropolis-Hastings(MH)算法是基础的马尔可夫链蒙特卡洛(MCMC)方法。本文探讨了能否借助范畴概率理论来形式化并分析MH算法,并以近期提出的针对MH类过程的对合框架作为具体案例进行研究。我们展示了如何用马尔可夫范畴表述MCMC的基本概念(如不变性与可逆性),以及如何利用标准CD范畴分析MH核的一部分。为进一步深入,我们研究了CD范畴在交换幺半群上的丰富化结构。这为抽象推理一系列重要概率概念提供了富有表现力的框架,包括子随机核、有限测度与$σ$有限测度、绝对连续性、奇异测度以及勒贝格分解。运用这些工具,我们给出了MH类采样器相对于给定目标分布具有可逆性的综合必要与充分条件。