Training Generative Adversarial Networks (GANs) remains a challenging problem. The discriminator trains the generator by learning the distribution of real/generated data. However, the distribution of generated data changes throughout the training process, which is difficult for the discriminator to learn. In this paper, we propose a novel method for GANs from the viewpoint of online continual learning. We observe that the discriminator model, trained on historically generated data, often slows down its adaptation to the changes in the new arrival generated data, which accordingly decreases the quality of generated results. By treating the generated data in training as a stream, we propose to detect whether the discriminator slows down the learning of new knowledge in generated data. Therefore, we can explicitly enforce the discriminator to learn new knowledge fast. Particularly, we propose a new discriminator, which automatically detects its retardation and then dynamically masks its features, such that the discriminator can adaptively learn the temporally-vary distribution of generated data. Experimental results show our method outperforms the state-of-the-art approaches.

翻译：训练生成对抗网络（GANs）始终是一个挑战性问题。判别器通过学习真实/生成数据的分布来训练生成器。然而，生成数据的分布在训练过程中不断变化，这使得判别器难以学习。本文从在线持续学习的视角，提出了一种针对GANs的新方法。我们观察到，基于历史生成数据训练的判别器模型，往往减缓了对新到达生成数据变化的适应速度，从而降低了生成结果的质量。通过将训练中的生成数据视为数据流，我们提出检测判别器是否减缓了对生成数据中新知识的学习。因此，我们能够明确强制判别器快速学习新知识。具体而言，我们提出了一种新型判别器，它能自动检测自身的滞后性，并动态掩码其特征，从而使判别器能够自适应地学习生成数据随时间变化的分布。实验结果表明，我们的方法优于当前最先进的方法。