Current deep learning approaches in medical image registration usually face the challenges of distribution shift and data collection, hindering real-world deployment. In contrast, universal medical image registration aims to perform registration on a wide range of clinically relevant tasks simultaneously, thus having tremendous potential for clinical applications. In this paper, we present the first attempt to achieve the goal of universal 3D medical image registration in sequential learning scenarios by proposing a continual learning method. Specifically, we utilize meta-learning with experience replay to mitigating the problem of catastrophic forgetting. To promote the generalizability of meta-continual learning, we further propose sharpness-aware meta-continual learning (SAMCL). We validate the effectiveness of our method on four datasets in a continual learning setup, including brain MR, abdomen CT, lung CT, and abdomen MR-CT image pairs. Results have shown the potential of SAMCL in realizing universal image registration, which performs better than or on par with vanilla sequential or centralized multi-task training strategies.The source code will be available from https://github.com/xzluo97/Continual-Reg.
翻译:当前医学图像配准中的深度学习方法通常面临分布偏移和数据收集的挑战,阻碍了其在现实世界中的部署。相比之下,通用医学图像配准旨在同时对广泛的临床相关任务执行配准,因而具有巨大的临床应用潜力。在本文中,我们通过提出一种持续学习方法,首次尝试在序列学习场景中实现通用三维医学图像配准的目标。具体而言,我们利用带有经验回放的元学习来缓解灾难性遗忘问题。为了提升元持续学习的泛化能力,我们进一步提出了锐度感知元持续学习(SAMCL)。我们在一个持续学习设置中,使用四个数据集验证了我们方法的有效性,包括脑部MR、腹部CT、肺部CT以及腹部MR-CT图像对。结果表明,SAMCL在实现通用图像配准方面具有潜力,其性能优于或与传统的序列式或集中式多任务训练策略相当。源代码将在 https://github.com/xzluo97/Continual-Reg 提供。