This work presents mixed variational flows (MixFlows), a new variational family that consists of a mixture of repeated applications of a map to an initial reference distribution. First, we provide efficient algorithms for i.i.d. sampling, density evaluation, and unbiased ELBO estimation. We then show that MixFlows have MCMC-like convergence guarantees when the flow map is ergodic and measure-preserving, and provide bounds on the accumulation of error for practical implementations where the flow map is approximated. Finally, we develop an implementation of MixFlows based on uncorrected discretized Hamiltonian dynamics combined with deterministic momentum refreshment. Simulated and real data experiments show that MixFlows can provide more reliable posterior approximations than several black-box normalizing flows, as well as samples of comparable quality to those obtained from state-of-the-art MCMC methods.

翻译：本文提出了混合变分流（MixFlows），这是一种新的变分族，由初始参考分布经映射重复应用后的混合组成。首先，我们提供了独立同分布采样、密度评估和无偏ELBO估计的高效算法。随后证明，当流映射是遍历且保测度时，MixFlows具有类似MCMC的收敛保证，并针对实际实现中流映射被近似的情况给出了误差累积的界。最后，我们基于未校正的离散化哈密顿动力学结合确定性动量刷新开发了MixFlows的实现。模拟和真实数据实验表明，MixFlows能够比若干黑箱归一化流提供更可靠的后验近似，同时生成与最先进MCMC方法质量相当的样本。