Hyperspectral 3D imaging aims to acquire both depth and spectral information of a scene. However, existing methods are either prohibitively expensive and bulky or compromise on spectral and depth accuracy. In this work, we present Dispersed Structured Light (DSL), a cost-effective and compact method for accurate hyperspectral 3D imaging. DSL modifies a traditional projector-camera system by placing a sub-millimeter thick diffraction grating film front of the projector. The grating disperses structured light based on light wavelength. To utilize the dispersed structured light, we devise a model for dispersive projection image formation and a per-pixel hyperspectral 3D reconstruction method. We validate DSL by instantiating a compact experimental prototype. DSL achieves spectral accuracy of 18.8nm full-width half-maximum (FWHM) and depth error of 1mm. We demonstrate that DSL outperforms prior work on practical hyperspectral 3D imaging. DSL promises accurate and practical hyperspectral 3D imaging for diverse application domains, including computer vision and graphics, cultural heritage, geology, and biology.
翻译:超光谱三维成像旨在同时获取场景的深度与光谱信息。然而,现有方法或成本高昂且体积庞大,或在光谱与深度精度上有所折衷。本文提出色散结构光(DSL),一种低成本、紧凑的高精度超光谱三维成像方法。DSL通过在投影仪前放置亚毫米厚衍射光栅膜片改进传统投影仪-相机系统。该光栅基于光波长对结构光进行色散。为利用色散结构光,我们设计了色散投影成像模型及逐像素超光谱三维重建方法。通过构建紧凑实验原型验证DSL,其光谱精度达18.8nm半峰全宽(FWHM),深度误差为1mm。实验表明,DSL在实用超光谱三维成像中优于先前工作。DSL可为计算机视觉与图形学、文化遗产、地质学及生物学等多领域提供精准且实用的超光谱三维成像方案。