We contribute to the sparsely populated area of unsupervised deep graph matching with application to keypoint matching in images. Contrary to the standard \emph{supervised} approach, our method does not require ground truth correspondences between keypoint pairs. Instead, it is self-supervised by enforcing consistency of matchings between images of the same object category. As the matching and the consistency loss are discrete, their derivatives cannot be straightforwardly used for learning. We address this issue in a principled way by building our method upon the recent results on black-box differentiation of combinatorial solvers. This makes our method exceptionally flexible, as it is compatible with arbitrary network architectures and combinatorial solvers. Our experimental evaluation suggests that our technique sets a new state-of-the-art for unsupervised graph matching.

翻译：我们贡献于无监督深度图匹配这一稀疏研究领域，并将其应用于图像中的关键点匹配。与标准的监督方法不同，我们的方法不需要关键点对之间的真实对应关系，而是通过强制同一物体类别图像之间匹配的一致性进行自我监督。由于匹配过程及其一致性损失是离散的，其导数无法直接用于学习。我们以原则性方式解决这一问题，将方法建立在组合求解器黑盒微分的近期研究成果之上。这使得我们的方法具有极佳的灵活性，能够兼容任意网络架构和组合求解器。实验评估表明，我们的技术为无监督图匹配树立了新的标杆。