In domain generalization (DG), the target domain is unknown when the model is being trained, and the trained model should successfully work on an arbitrary (and possibly unseen) target domain during inference. This is a difficult problem, and despite active studies in recent years, it remains a great challenge. In this paper, we take a simple yet effective approach to tackle this issue. We propose test-time style shifting, which shifts the style of the test sample (that has a large style gap with the source domains) to the nearest source domain that the model is already familiar with, before making the prediction. This strategy enables the model to handle any target domains with arbitrary style statistics, without additional model update at test-time. Additionally, we propose style balancing, which provides a great platform for maximizing the advantage of test-time style shifting by handling the DG-specific imbalance issues. The proposed ideas are easy to implement and successfully work in conjunction with various other DG schemes. Experimental results on different datasets show the effectiveness of our methods.
翻译:在领域泛化(DG)中,模型训练时目标领域未知,训练后的模型需在推理阶段成功适应任意(可能未见过的)目标领域。这是一个具有挑战性的问题,尽管近年来相关研究活跃,但仍是重大难题。本文提出一种简单而有效的方法来解决该问题。我们提出测试时风格迁移,即在做出预测之前,将测试样本的风格(若与源领域存在较大风格差异)转移到模型已熟悉的最邻近源领域。该策略使模型能够处理具有任意风格统计特征的目标领域,且无需在测试时更新模型。此外,我们提出风格平衡技术,通过处理领域泛化特有的不平衡问题,为最大化测试时风格迁移的优势提供了优越平台。所提方法易于实现,并能与多种其他领域泛化方案协同工作。在不同数据集上的实验结果表明了方法的有效性。