In semi-supervised domain adaptation (SSDA), a few labeled target samples of each class help the model to transfer knowledge representation from the fully labeled source domain to the target domain. Many existing methods ignore the benefits of making full use of the labeled target samples from multi-level. To make better use of this additional data, we propose a novel Prototype-based Multi-level Learning (ProML) framework to better tap the potential of labeled target samples. To achieve intra-domain adaptation, we first introduce a pseudo-label aggregation based on the intra-domain optimal transport to help the model align the feature distribution of unlabeled target samples and the prototype. At the inter-domain level, we propose a cross-domain alignment loss to help the model use the target prototype for cross-domain knowledge transfer. We further propose a dual consistency based on prototype similarity and linear classifier to promote discriminative learning of compact target feature representation at the batch level. Extensive experiments on three datasets, including DomainNet, VisDA2017, and Office-Home demonstrate that our proposed method achieves state-of-the-art performance in SSDA.
翻译:在半监督域适应(SSDA)中,每类少量有标签的目标样本有助于模型将知识表征从完全标注的源域迁移到目标域。现有许多方法忽略了从多层级充分利用有标签目标样本的优势。为更好地利用这些额外数据,我们提出了一种新颖的基于原型的多层级学习(ProML)框架,以深度挖掘有标签目标样本的潜力。为实现域内自适应,我们首先引入了基于域内最优传输的伪标签聚合策略,帮助模型对齐无标签目标样本特征分布与原型。在跨域层面,我们提出了跨域对齐损失,帮助模型利用目标原型进行跨域知识迁移。进一步地,我们基于原型相似性和线性分类器提出双重一致性约束,以在批次级别促进判别性学习,形成紧凑的目标特征表征。在包括DomainNet、VisDA2017和Office-Home在内的三个数据集上的大量实验表明,我们提出的方法在半监督域适应任务中达到了最优性能。