In medical imaging, the diffusion models have shown great potential in synthetic image generation tasks. However, these models often struggle with the interpretable connections between the generated and existing images and could create illusions. To address these challenges, our research proposes a novel diffusion-based generative model based on deformation diffusion and recovery. This model, named Deformation-Recovery Diffusion Model (DRDM), diverges from traditional score/intensity and latent feature-based approaches, emphasizing morphological changes through deformation fields rather than direct image synthesis. This is achieved by introducing a topological-preserving deformation field generation method, which randomly samples and integrates a set of multi-scale Deformation Vector Fields (DVF). DRDM is trained to learn to recover unreasonable deformation components, thereby restoring each randomly deformed image to a realistic distribution. These innovations facilitate the generation of diverse and anatomically plausible deformations, enhancing data augmentation and synthesis for further analysis in downstream tasks, such as few-shot learning and image registration. Experimental results in cardiac MRI and pulmonary CT show DRDM is capable of creating diverse, large (over 10\% image size deformation scale), and high-quality (negative rate of the Jacobian matrix's determinant is lower than 1\%) deformation fields. The further experimental results in downstream tasks, 2D image segmentation and 3D image registration, indicate significant improvements resulting from DRDM, showcasing the potential of our model to advance image manipulation and synthesis in medical imaging and beyond. Project page: https://jianqingzheng.github.io/def_diff_rec/
翻译:在医学影像领域,扩散模型在合成图像生成任务中展现出巨大潜力。然而,这些模型往往难以建立生成图像与现有图像之间的可解释关联,且可能产生伪影。为应对这些挑战,本研究提出一种基于变形扩散与恢复的新型扩散生成模型。该模型命名为变形-恢复扩散模型(DRDM),区别于传统的基于分数/强度及潜在特征的方法,其核心在于通过变形场强调形态学变化而非直接图像合成。这一目标通过引入拓扑保持的变形场生成方法实现,该方法随机采样并融合一组多尺度变形矢量场(DVF)。DRDM经训练学习恢复不合理变形分量,从而将每个随机变形图像还原至真实分布。这些创新有助于生成多样化且解剖学合理的变形,增强了下游任务(如少样本学习与图像配准)中数据增强与合成的能力。心脏MRI与肺部CT的实验结果表明,DRDM能够生成多样化、大尺度(变形幅度超过图像尺寸10%)且高质量(雅可比矩阵行列式负值率低于1%)的变形场。在二维图像分割与三维图像配准等下游任务中的进一步实验结果,证实了DRDM带来的显著性能提升,展现了本模型在医学影像及其他领域推动图像操控与合成技术发展的潜力。项目页面:https://jianqingzheng.github.io/def_diff_rec/