3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale landforms and cities. Even with low-altitude UAVs (Unmanned Aerial Vehicles), 3D reconstruction in complicated situations, such as urban canyons and indoor scenes, is challenging due to frequent tracking failures between camera frames and high data collection costs. Recently, spherical images have been extensively used due to the capability of recording surrounding environments from one camera exposure. In contrast to perspective images with limited FOV (Field of View), spherical images can cover the whole scene with full horizontal and vertical FOV and facilitate camera tracking and data acquisition in these complex scenes. With the rapid evolution and extensive use of professional and consumer-grade spherical cameras, spherical images show great potential for the 3D modeling of urban and indoor scenes. Classical 3D reconstruction pipelines, however, cannot be directly used for spherical images. Besides, there exist few software packages that are designed for the 3D reconstruction of spherical images. As a result, this research provides a thorough survey of the state-of-the-art for 3D reconstruction of spherical images in terms of data acquisition, feature detection and matching, image orientation, and dense matching as well as presenting promising applications and discussing potential prospects. We anticipate that this study offers insightful clues to direct future research.

翻译：三维重建在现代摄影测量系统中扮演着日益重要的角色。传统的卫星或航空遥感平台可为大规模地形和城市的三维重建提供必要的数据源。即使使用低空无人机，在城市峡谷和室内场景等复杂环境中进行三维重建仍面临挑战，这主要是由于相机帧间频繁的跟踪失败以及高昂的数据采集成本。近年来，球形图像因能通过一次相机曝光记录周围环境而得到广泛应用。与视场角有限的透视图像不同，球形图像可覆盖完整水平与垂直视场角的全景场景，有助于在复杂场景中实现相机跟踪与数据采集。随着专业级与消费级球形相机的快速演进与普及，球形图像在城市与室内场景的三维建模中展现出巨大潜力。然而，经典的三维重建流水线无法直接应用于球形图像。此外，目前专为球形图像三维重建设计的软件包屈指可数。为此，本研究从数据采集、特征检测与匹配、影像定向以及密集匹配四个方面，全面综述了面向球形图像三维重建的最新方法，并介绍了具有前景的应用案例与潜在的发展方向。我们期望本研究能为未来研究方向提供富有洞见的指引。