For a considerable time, researchers have focused on developing a method that establishes a deep connection between the generative diffusion model and mathematical physics. Despite previous efforts, progress has been limited to the pursuit of a single specialized method. In order to advance the interpretability of diffusion models and explore new research directions, it is essential to establish a unified ODE-style generative diffusion model. Such a model should draw inspiration from physical models and possess a clear geometric meaning. This paper aims to identify various physical models that are suitable for constructing ODE-style generative diffusion models accurately from a mathematical perspective. We then summarize these models into a unified method. Additionally, we perform a case study where we use the theoretical model identified by our method to develop a range of new diffusion model methods, and conduct experiments. Our experiments on CIFAR-10 demonstrate the effectiveness of our approach. We have constructed a computational framework that attains highly proficient results with regards to image generation speed, alongside an additional model that demonstrates exceptional performance in both Inception score and FID score. These results underscore the significance of our method in advancing the field of diffusion models.
翻译:长期以来,研究者们一直致力于发展一种能够建立生成扩散模型与数学物理之间深刻联系的方法。尽管已有诸多尝试,但进展仅限于对单一特定方法的追求。为提升扩散模型的可解释性并探索新的研究方向,建立一种统一的ODE式生成扩散模型至关重要。此类模型应从物理模型中汲取灵感,并具有清晰的几何含义。本文旨在从数学角度精确识别适合构建ODE式生成扩散模型的各种物理模型,进而将这些模型归纳为统一方法。此外,我们通过案例研究,利用该方法确定的理论模型开发了一系列新型扩散模型方法,并进行了实验验证。我们在CIFAR-10上的实验证明了方法的有效性。所构建的计算框架在图像生成速度方面取得了高度优异的结果,同时另一模型在Inception评分和FID评分上均展现出卓越性能。这些结果突显了我们的方法在推动扩散模型领域发展方面的重要意义。