Monocular Re-Localization (MRL) is a critical component in numerous autonomous applications, which estimates 6 degree-of-freedom poses with regards to the scene map based on a single monocular image. In recent decades, significant progress has been made in the development of MRL techniques. Numerous landmark algorithms have accomplished extraordinary success in terms of localization accuracy and robustness against visual interference. In MRL research, scene maps are represented in various forms, and they determine how MRL methods work and even how MRL methods perform. However, to the best of our knowledge, existing surveys do not provide systematic reviews of MRL from the respective of map. This survey fills the gap by comprehensively reviewing MRL methods employing monocular cameras as main sensors, promoting further research. 1) We commence by delving into the problem definition of MRL and exploring current challenges, while also comparing ours with with previous published surveys. 2) MRL methods are then categorized into five classes according to the representation forms of utilized map, i.e., geo-tagged frames, visual landmarks, point clouds, and vectorized semantic map, and we review the milestone MRL works of each category. 3) To quantitatively and fairly compare MRL methods with various map, we also review some public datasets and provide the performances of some typical MRL methods. The strengths and weakness of different types of MRL methods are analyzed. 4) We finally introduce some topics of interest in this field and give personal opinions. This survey can serve as a valuable referenced materials for newcomers and researchers interested in MRL, and a continuously updated summary of this survey, including reviewed papers and datasets, is publicly available to the community at: https://github.com/jinyummiao/map-in-mono-reloc.
翻译:单目重定位(Monocular Re-Localization, MRL)是众多自主应用中的关键组成部分,其基于单张单目图像估计相对于场景地图的六自由度位姿。近几十年来,MRL技术取得了显著进展,大量里程碑式算法在定位精度和抗视觉干扰鲁棒性方面实现了非凡成功。在MRL研究中,场景地图以多种形式表示,这些表示形式决定了MRL方法的工作方式甚至性能表现。然而,据我们所知,现有综述尚未从地图视角对MRL进行系统梳理。本综述通过全面评述以单目相机为主传感器的MRL方法填补这一空白,以促进后续研究。1)我们首先深入探讨MRL的问题定义与当前挑战,同时将本文与已发表综述进行对比。2)根据所用地图的表示形式,将MRL方法分为五类(地理标记帧、视觉地标、点云、向量化语义地图),并评述每类中的里程碑式工作。3)为定量公平比较不同地图类型的MRL方法,我们梳理了部分公开数据集,并展示了若干典型MRL方法的性能表现,分析了不同方法的优缺点。4)最后介绍该领域的研究热点并给出个人见解。本综述可作为MRL领域新手与研究人员的重要参考资料,其持续更新的总结(含评述论文与数据集)公开获取地址为:https://github.com/jinyummiao/map-in-mono-reloc。