We present GlintMarkers, the first system to perform gaze-driven spatial perception using the inward-facing cameras on XR eyewear. Our key observation is that the cornea acts as a mirror that encodes both gaze direction and visual information about the environment in a small, low-contrast reflection. To extract spatial and semantic information from this reflection despite the camera's limited pixel budget, we present a passive retroreflective marker design that concentrates reflected near-infrared light onto the cornea, producing bright glint patterns. We develop a custom Perspective-n-Point (PnP) estimation framework adapted to corneal imaging and perform orientation and distance estimation of tagged objects, as well as unique object identification.

翻译：我们提出GlintMarkers，这是首个利用XR眼镜上的内向摄像头执行基于注视的空间感知的系统。我们的关键发现是，角膜充当了一面镜子，在一小块低对比度的反射中同时编码了注视方向及环境视觉信息。为了在摄像头有限的像素预算下从这些反射中提取空间与语义信息，我们设计了一种被动逆反射标记方案，该方案将反射的近红外光集中到角膜上，形成明亮的高光图案。我们开发了一种适配角膜成像的定制化透视n点（PnP）估计框架，并实现了对标记物体的朝向与距离估计，以及唯一物标识别。