In biomedical image analysis, the applicability of deep learning methods is directly impacted by the quantity of image data available. This is due to deep learning models requiring large image datasets to provide high-level performance. Generative Adversarial Networks (GANs) have been widely utilized to address data limitations through the generation of synthetic biomedical images. GANs consist of two models. The generator, a model that learns how to produce synthetic images based on the feedback it receives. The discriminator, a model that classifies an image as synthetic or real and provides feedback to the generator. Throughout the training process, a GAN can experience several technical challenges that impede the generation of suitable synthetic imagery. First, the mode collapse problem whereby the generator either produces an identical image or produces a uniform image from distinct input features. Second, the non-convergence problem whereby the gradient descent optimizer fails to reach a Nash equilibrium. Thirdly, the vanishing gradient problem whereby unstable training behavior occurs due to the discriminator achieving optimal classification performance resulting in no meaningful feedback being provided to the generator. These problems result in the production of synthetic imagery that is blurry, unrealistic, and less diverse. To date, there has been no survey article outlining the impact of these technical challenges in the context of the biomedical imagery domain. This work presents a review and taxonomy based on solutions to the training problems of GANs in the biomedical imaging domain. This survey highlights important challenges and outlines future research directions about the training of GANs in the domain of biomedical imagery.
翻译:在生物医学图像分析中,深度学习方法的适用性直接受可用图像数据量的影响。这是由于深度学习模型需要大规模图像数据集才能提供高性能表现。生成对抗网络(GANs)已被广泛用于通过生成合成生物医学图像来解决数据局限性问题。GANs由两个模型组成:生成器(通过学习根据接收的反馈产生合成图像的模型)和判别器(将图像分类为合成或真实图像并向生成器提供反馈的模型)。在训练过程中,GANs可能面临若干技术挑战,阻碍其生成恰当的合成图像。其一为模式坍塌问题,即生成器对不同输入特征产生相同图像或一致图像;其二为非收敛问题,即梯度下降优化器未能达到纳什均衡;其三为梯度消失问题,即判别器达到最优分类性能导致无法向生成器提供有效反馈,从而引发不稳定的训练行为。这些问题导致生成的合成图像模糊、不真实且多样性不足。迄今为止,尚未有综述文章系统阐述这些技术挑战在生物医学图像领域中的影响。本文针对生物医学成像领域GANs训练问题的解决方案进行了综述与分类,重点阐述了关键挑战,并指出了该领域GANs训练的未来研究方向。