Spectral 3D computer vision examines both the geometric and spectral properties of objects. It provides a deeper understanding of an object's physical properties by providing information from narrow bands in various regions of the electromagnetic spectrum. Mapping the spectral information onto the 3D model reveals changes in the spectra-structure space or enhances 3D representations with properties such as reflectance, chromatic aberration, and varying defocus blur. This emerging paradigm advances traditional computer vision and opens new avenues of research in 3D structure, depth estimation, motion analysis, and more. It has found applications in areas such as smart agriculture, environment monitoring, building inspection, geological exploration, and digital cultural heritage records. This survey offers a comprehensive overview of spectral 3D computer vision, including a unified taxonomy of methods, key application areas, and future challenges and prospects.
翻译:光谱三维计算机视觉同时研究物体的几何特性与光谱特性。该技术通过获取电磁波谱不同区域窄波段的信息,为深入理解物体物理属性提供了新途径。将光谱信息映射至三维模型,可揭示光谱-结构空间的变化,或通过反射率、色差、变焦散焦模糊等属性增强三维表征。这一新兴范式推动了传统计算机视觉的发展,并在三维结构、深度估计、运动分析等领域开拓了新的研究方向。该技术已在智慧农业、环境监测、建筑检测、地质勘探和数字文化遗产记录等领域得到应用。本综述全面概述了光谱三维计算机视觉领域,包括统一的方法分类体系、关键应用领域及未来挑战与发展前景。