Current clothes-changing person re-identification (re-id) approaches usually perform retrieval based on clothes-irrelevant features, while neglecting the potential of clothes-relevant features. However, we observe that relying solely on clothes-irrelevant features for clothes-changing re-id is limited, since they often lack adequate identity information and suffer from large intra-class variations. On the contrary, clothes-relevant features can be used to discover same-clothes intermediaries that possess informative identity clues. Based on this observation, we propose a Feasibility-Aware Intermediary Matching (FAIM) framework to additionally utilize clothes-relevant features for retrieval. Firstly, an Intermediary Matching (IM) module is designed to perform an intermediary-assisted matching process. This process involves using clothes-relevant features to find informative intermediates, and then using clothes-irrelevant features of these intermediates to complete the matching. Secondly, in order to reduce the negative effect of low-quality intermediaries, an Intermediary-Based Feasibility Weighting (IBFW) module is designed to evaluate the feasibility of intermediary matching process by assessing the quality of intermediaries. Extensive experiments demonstrate that our method outperforms state-of-the-art methods on several widely-used clothes-changing re-id benchmarks.
翻译:当前换衣行人重识别方法通常基于与衣物无关的特征进行检索,却忽视了衣物相关特征的潜在价值。然而,我们发现仅依赖衣物无关特征进行换衣行人重识别存在局限性,因为这些特征通常缺乏充分的身份信息,且存在较大的类内差异。相反,衣物相关特征可用于发现具有相同衣物的中介对象,这些中介对象包含丰富的身份线索。基于这一观察,我们提出了一种可行性感知的中介匹配框架,以额外利用衣物相关特征进行检索。首先,设计了一个中介匹配模块,执行中介辅助的匹配过程:利用衣物相关特征寻找信息丰富的中介对象,再通过中介对象的衣物无关特征完成匹配。其次,为降低低质量中介的负面影响,设计了基于中介的可行性加权模块,通过评估中介质量来判断中介匹配过程的可行性。大量实验证明,该方法在多个广泛使用的换衣行人重识别基准上优于现有最先进方法。