Losing track of reading progress during line switching can be frustrating. Eye gaze tracking technology offers a potential solution by highlighting read paragraphs, aiding users in avoiding wrong line switches. However, the gap between gaze tracking accuracy (2-3 cm) and text line spacing (3-5 mm) makes direct application impractical. Existing methods leverage the linear reading pattern but fail during jump reading. This paper presents a reading tracking and highlighting system that supports both linear and jump reading. Based on experimental insights from the gaze nature study of 16 users, two gaze error models are designed to enable both jump reading detection and relocation. The system further leverages the large language model's contextual perception capability in aiding reading tracking. A reading tracking domain-specific line-gaze alignment opportunity is also exploited to enable dynamic and frequent calibration of the gaze results. Controlled experiments demonstrate reliable linear reading tracking, as well as 84% accuracy in tracking jump reading. Furthermore, real field tests with 18 volunteers demonstrated the system's effectiveness in tracking and highlighting read paragraphs, improving reading efficiency, and enhancing user experience.
翻译:在阅读过程中因换行而丢失进度是令人沮丧的。眼动追踪技术通过高亮已读段落,为用户提供了一种潜在的解决方案,有助于避免错误换行。然而,眼动追踪精度(2-3厘米)与文本行间距(3-5毫米)之间的差距使得直接应用并不现实。现有方法利用了线性阅读模式,但在跳读时失效。本文提出了一种支持线性阅读与跳读的阅读追踪与高亮系统。基于对16名用户的眼动特性研究获得的实验洞见,我们设计了两种眼动误差模型,以实现跳读检测与重定位。该系统进一步利用了大语言模型的上下文感知能力来辅助阅读追踪。我们还利用阅读追踪领域特有的视线-文本行对齐机会,实现了对眼动结果的动态、频繁校准。受控实验表明,系统在线性阅读追踪方面表现可靠,并且在跳读追踪中达到了84%的准确率。此外,对18名志愿者的实际场景测试证明,该系统在追踪和高亮已读段落、提升阅读效率以及改善用户体验方面是有效的。