There is a long-standing problem of repeated patterns in correspondence problems, where mismatches frequently occur because of inherent ambiguity. The unique position information associated with repeated patterns makes coordinate representations a useful supplement to appearance representations for improving feature correspondences. However, the issue of appropriate coordinate representation has remained unresolved. In this study, we demonstrate that geometric-invariant coordinate representations, such as barycentric coordinates, can significantly reduce mismatches between features. The first step is to establish a theoretical foundation for geometrically invariant coordinates. We present a seed matching and filtering network (SMFNet) that combines feature matching and consistency filtering with a coarse-to-fine matching strategy in order to acquire reliable sparse correspondences. We then introduce DEGREE, a novel anchor-to-barycentric (A2B) coordinate encoding approach, which generates multiple affine-invariant correspondence coordinates from paired images. DEGREE can be used as a plug-in with standard descriptors, feature matchers, and consistency filters to improve the matching quality. Extensive experiments in synthesized indoor and outdoor datasets demonstrate that DEGREE alleviates the problem of repeated patterns and helps achieve state-of-the-art performance. Furthermore, DEGREE also reports competitive performance in the third Image Matching Challenge at CVPR 2021. This approach offers a new perspective to alleviate the problem of repeated patterns and emphasizes the importance of choosing coordinate representations for feature correspondences.
翻译:在对应问题中,重复模式长期存在,由于固有的歧义性,误匹配频繁发生。与重复模式相关联的唯一位置信息使坐标表示成为外观表示的有益补充,可改进特征对应。然而,合适的坐标表示问题仍未解决。本研究证明,几何不变坐标表示(如重心坐标)能显著减少特征间的误匹配。首先,我们为几何不变坐标建立理论基石。提出一种种子匹配与过滤网络(SMFNet),结合特征匹配与一致性过滤及粗到细的匹配策略,以获取可靠的稀疏对应。然后引入DEGREE——一种新颖的锚点到重心(A2B)坐标编码方法,从配对图像生成多个仿射不变的对应坐标。DEGREE可作为插件与标准描述子、特征匹配器和一致性过滤模块配合使用,提升匹配质量。在合成室内外数据集上的大量实验表明,DEGREE缓解了重复模式问题,并实现了最先进的性能。此外,DEGREE在CVPR 2021第三届图像匹配挑战赛中也报告了具有竞争力的表现。该方法为缓解重复模式问题提供了新视角,并强调了选择坐标表示对特征对应的重要性。