The relatively hot temperature of the human body causes people to turn into long-wave infrared light sources. Since this emitted light has a larger wavelength than visible light, many surfaces in typical scenes act as infrared mirrors with strong specular reflections. We exploit the thermal reflections of a person onto objects in order to locate their position and reconstruct their pose, even if they are not visible to a normal camera. We propose an analysis-by-synthesis framework that jointly models the objects, people, and their thermal reflections, which allows us to combine generative models with differentiable rendering of reflections. Quantitative and qualitative experiments show our approach works in highly challenging cases, such as with curved mirrors or when the person is completely unseen by a normal camera.

翻译：人体较高的温度使其成为长波红外光源。由于此类发射光的波长大于可见光，典型场景中的许多表面会表现为具有强镜面反射特性的红外镜面。我们利用人体在物体上的热反射来定位其位置并重建姿态，即使普通相机无法直接观测到该人体。本文提出一种基于分析-合成框架的方法，该框架联合建模物体、人体及其热反射，使我们能够将生成模型与可微反射渲染相结合。定量与定性实验表明，该方法在极具挑战性的场景中（如曲面镜反射或人体完全处于普通相机视野之外时）依然有效。