Test-time adaptation (TTA), a key component of lifelong learning in edge devices, refers to the ability of a pre-trained model to adapt itself to new environments during test time. Due to its practical ability, TTA has attracted significant attention and experienced a rapid performance boost these days. In this paper, we present an under-explored yet more realistic TTA scenario and provide a strong baseline favorable to this scenario, named cyclical compound domain (CCD). The CCD represents the real-world scenario in which the target domain contains multiple sub-target domains (i.e., compound domain due to weather or time change) and the sub-target domains are likely to rise cyclically. Unfortunately, existing works do not faithfully account for this plausible scenario, only focusing on adapting to the current sub-target domain while discarding the past knowledge acquired from repeated sub-target domains. Therefore, we first propose a lightweight domain-matching algorithm that allows the TTA model to manage knowledge from the compound domain. This algorithm identifies the type of domain among sub-target domains by continuously matching the current image's distribution with reference domain points. Moreover, our newly proposed regularization method compares the present distribution with source one in order to regularize the adaptation pace according to each data in sub-target domains. Qualitatively, we demonstrate that our simple-yet-effective approach improves the adaptation performance on various benchmarks, including image classification on ImageNet-C and semantic segmentation on GTA5, C-driving datasets, and Cityscapes with corruptions.
翻译:测试时自适应(TTA)作为边缘设备终身学习的关键组成部分,指预训练模型在测试阶段适应新环境的能力。因其实际应用价值,TTA近年来备受关注并取得性能的快速提升。本文提出一种尚未充分探索但更具现实意义的TTA场景,并为此场景提供名为周期复合域(CCD)的强基线方法。CCD描述了目标域包含多个子目标域(如因天气或时间变化形成的复合域)且子目标域可能周期性出现的真实场景。然而现有研究未能充分处理这一合理场景,仅关注适应当前子目标域而丢弃从重复出现的子目标域中获取的历史知识。为此,我们首先提出轻量级域匹配算法,使TTA模型能够管理复合域中的知识。该算法通过连续匹配当前图像分布与参考域特征点,识别当前图像所属的子目标域类型。此外,我们提出的新型正则化方法通过比较当前分布与源域分布,根据子目标域中每个数据特性调控适应节奏。实验结果表明,这种简单高效的方法在多种基准测试中提升了自适应性能,包括ImageNet-C的图像分类任务,以及GTA5、C-driving数据集和添加扰动的Cityscapes上的语义分割任务。