Hyperspectral 3D imaging aims to acquire both depth and spectral information of a scene. However, existing methods are either prohibitively expensive and bulky or compromise on spectral and depth accuracy. In this work, we present Dispersed Structured Light (DSL), a cost-effective and compact method for accurate hyperspectral 3D imaging. DSL modifies a traditional projector-camera system by placing a sub-millimeter thick diffraction grating film front of the projector. The grating disperses structured light based on light wavelength. To utilize the dispersed structured light, we devise a model for dispersive projection image formation and a per-pixel hyperspectral 3D reconstruction method. We validate DSL by instantiating a compact experimental prototype. DSL achieves spectral accuracy of 18.8nm full-width half-maximum (FWHM) and depth error of 1mm. We demonstrate that DSL outperforms prior work on practical hyperspectral 3D imaging. DSL promises accurate and practical hyperspectral 3D imaging for diverse application domains, including computer vision and graphics, cultural heritage, geology, and biology.
翻译:高光谱三维成像旨在同时获取场景的深度与光谱信息。然而,现有方法要么成本高昂且体积庞大,要么在光谱与深度精度上有所妥协。本文提出一种经济紧凑的色散结构光(DSL)方法,用于实现高精度的高光谱三维成像。DSL通过在传统投影仪-相机系统前放置亚毫米厚衍射光栅薄膜来改进系统:光栅依据光波长对结构光进行色散。为利用色散后的结构光,我们建立了色散投影图像形成模型,并提出一种逐像素的高光谱三维重建方法。通过构建紧凑实验样机验证了DSL性能:其光谱精度达到18.8纳米半高全宽(FWHM),深度误差为1毫米。实验表明,DSL在实际高光谱三维成像中优于已有工作。该技术为计算机视觉与图形学、文化遗产保护、地质学及生物学等多元应用领域提供了精准、实用的高光谱三维成像方案。