We break the mold in flow-based generative modeling by proposing a new model based on the damped wave equation, also known as telegrapher's equation. Similar to the diffusion equation and Brownian motion, there is a Feynman-Kac type relation between the telegrapher's equation and the stochastic Kac process in 1D. The Kac flow evolves stepwise linearly in time, so that the probability flow is Lipschitz continuous in the Wasserstein distance and, in contrast to diffusion flows, the norm of the velocity is globally bounded. Furthermore, the Kac model has the diffusion model as its asymptotic limit. We extend these considerations to a multi-dimensional stochastic process which consists of independent 1D Kac processes in each spatial component. We show that this process gives rise to an absolutely continuous curve in the Wasserstein space and compute the conditional velocity field starting in a Dirac point analytically. Using the framework of flow matching, we train a neural network that approximates the velocity field and use it for sample generation. Our numerical experiments demonstrate the scalability of our approach, and show its advantages over diffusion models.
翻译:本文在基于流的生成建模领域提出突破性创新,通过引入基于阻尼波动方程(即电报方程)的新型模型。与扩散方程和布朗运动类似,电报方程与一维随机Kac过程之间存在费曼-卡茨型关系。Kac流随时间分段线性演化,使得概率流在Wasserstein距离下具有Lipschitz连续性,且与扩散流不同,其速度范数具有全局有界性。此外,Kac模型以扩散模型为其渐近极限。我们将这些考量推广至多维随机过程,该过程由各空间分量上独立的1D Kac过程构成。我们证明该过程在Wasserstein空间中生成绝对连续曲线,并解析计算了从狄拉克点出发的条件速度场。借助流匹配框架,我们训练了逼近速度场的神经网络并用于样本生成。数值实验证明了方法的可扩展性,并展示了其相对于扩散模型的优势。