Inverse rendering remains a core challenge in graphics and vision, especially in the snapshot configurations required for lightweight desktop workflows, where the per-frame information budget is highly constrained. Previous inverse rendering work explores various available dimensions for enriching the per-shot information, including temporal modulation, spectral encoding, and polarization. In this work, we introduce polarimetric display inverse rendering, using an LCD to project a linearly polarized RGB binary pattern and an RGB polarization camera augmented with a quarter-wave plate to acquire spectro-polarimetric measurements in a single shot. A feed-forward transformer maps these measurements to per-pixel normal, albedo, roughness, and metallicity. To overcome training data scarcity, we expand a limited set of measured polarimetric bidirectional reflectance distribution functions via a generative manifold. Evaluations on a real desktop setup demonstrate accurate inverse rendering across diverse scenes, outperforming existing approaches.
翻译:逆渲染仍然是图形学和视觉领域的核心挑战,尤其是在轻量级桌面工作流所需的快照配置中,每帧信息预算高度受限。此前的逆渲染研究工作探索了多种可用于丰富单次采集信息的维度,包括时间调制、光谱编码和偏振。在本工作中,我们引入偏振显示逆渲染,利用LCD投射线性偏振RGB二进制图案,并使用配备四分之一波片的RGB偏振相机在单次拍摄中获取光谱偏振测量值。一种前馈Transformer将这些测量值映射到每个像素的法线、反照率、粗糙度和金属度。为了克服训练数据稀缺的问题,我们通过生成流形扩展一组有限的实测偏振双向反射分布函数。在真实桌面设备上的评估表明,该方法在多种场景下实现了准确的逆渲染,性能优于现有方法。