Local feature matching is challenging due to textureless and repetitive patterns. Existing methods focus on using appearance features and global interaction and matching, while the importance of geometry priors in local feature matching has not been fully exploited. Different from these methods, in this paper, we delve into the importance of geometry prior and propose Structured Epipolar Matcher (SEM) for local feature matching, which can leverage the geometric information in an iterative matching way. The proposed model enjoys several merits. First, our proposed Structured Feature Extractor can model the relative positional relationship between pixels and high-confidence anchor points. Second, our proposed Epipolar Attention and Matching can filter out irrelevant areas by utilizing the epipolar constraint. Extensive experimental results on five standard benchmarks demonstrate the superior performance of our SEM compared to state-of-the-art methods. Project page: https://sem2023.github.io.
翻译:局部特征匹配因纹理缺失和重复图案而具有挑战性。现有方法侧重于利用外观特征和全局交互与匹配,而几何先验在局部特征匹配中的重要性尚未得到充分利用。与这些方法不同,本文深入探讨了几何先验的重要性,提出了一种用于局部特征匹配的结构化极线匹配器(SEM),该模型能以迭代匹配的方式利用几何信息。所提出的模型具有若干优势。首先,我们提出的结构化特征提取器能够建模像素与高置信度锚点之间的相对位置关系。其次,我们提出的极线注意力与匹配模块能够利用极线约束滤除不相关区域。在五个标准基准上的大量实验结果表明,我们的SEM相比现有最优方法具有更优越的性能。项目页面:https://sem2023.github.io。