Although Domain Generalization (DG) problem has been fast-growing in the 2D image tasks, its exploration on 3D point cloud data is still insufficient and challenged by more complex and uncertain cross-domain variances with uneven inter-class modality distribution. In this paper, different from previous 2D DG works, we focus on the 3D DG problem and propose a Single-dataset Unified Generalization (SUG) framework that only leverages a single source dataset to alleviate the unforeseen domain differences faced by a well-trained source model. Specifically, we first design a Multi-grained Sub-domain Alignment (MSA) method, which can constrain the learned representations to be domain-agnostic and discriminative, by performing a multi-grained feature alignment process between the splitted sub-domains from the single source dataset. Then, a Sample-level Domain-aware Attention (SDA) strategy is presented, which can selectively enhance easy-to-adapt samples from different sub-domains according to the sample-level inter-domain distance to avoid the negative transfer. Experiments demonstrate that our SUG can boost the generalization ability for unseen target domains, even outperforming the existing unsupervised domain adaptation methods that have to access extensive target domain data. Our code is available at https://github.com/SiyuanHuang95/SUG.
翻译:尽管域泛化(Domain Generalization, DG)问题在二维图像任务中发展迅速,但在三维点云数据上的研究仍显不足,且面临更复杂、更具不确定性的跨域差异及类别间模态分布不均等挑战。本文不同于以往二维域泛化工作,聚焦三维域泛化问题,提出一种仅利用单一源数据集即可缓解训练模型面临的未知域差异的单数据集统一泛化(Single-dataset Unified Generalization, SUG)框架。具体地,我们首先设计了多粒度子域对齐(Multi-grained Sub-domain Alignment, MSA)方法,通过对单一源数据集中划分的子域执行多粒度特征对齐过程,约束学习到的表征具有域无关性和判别性。其次,提出样本级域感知注意力(Sample-level Domain-aware Attention, SDA)策略,该策略可根据样本级跨域距离,从不同子域中选择性增强易适应样本,从而避免负迁移。实验表明,我们的SUG能够提升对未见目标域的泛化能力,甚至优于需要访问大量目标域数据的现有无监督域适应方法。我们的代码已开源:https://github.com/SiyuanHuang95/SUG。