The reflective nature of the human eye is an underappreciated source of information about what the world around us looks like. By imaging the eyes of a moving person, we can collect multiple views of a scene outside the camera's direct line of sight through the reflections in the eyes. In this paper, we reconstruct a 3D scene beyond the camera's line of sight using portrait images containing eye reflections. This task is challenging due to 1) the difficulty of accurately estimating eye poses and 2) the entangled appearance of the eye iris and the scene reflections. Our method jointly refines the cornea poses, the radiance field depicting the scene, and the observer's eye iris texture. We further propose a simple regularization prior on the iris texture pattern to improve reconstruction quality. Through various experiments on synthetic and real-world captures featuring people with varied eye colors, we demonstrate the feasibility of our approach to recover 3D scenes using eye reflections.

翻译：人类眼睛的反射特性是了解周围世界外观的一个常被低估的信息来源。通过拍摄运动中的人的眼睛图像，我们能够从眼球反射中收集到相机直接视线之外的场景的多视角信息。本文利用包含眼球反射的人像图像，重建了相机视线之外的3D场景。这一任务面临两大挑战：1）精确估计眼球姿态的困难性，以及2）虹膜外观与场景反射的纠缠。我们的方法联合优化了角膜姿态、描述场景的辐射场以及观察者的虹膜纹理。我们进一步提出了一个基于虹膜纹理模式的简单正则化先验，以提升重建质量。通过在合成和真实场景中针对不同眼色人物的广泛实验，我们证明了利用眼球反射恢复3D场景这一方法的可行性。