Do patterns of eye-hand coordination observed during real-world object interactions apply to digital, screen-based object interactions? We adapted a real-world object interaction task (physically transferring cups in sequence about a tabletop) into a two-dimensional screen-based task (dragging-and-dropping circles in sequence with a cursor). We collected gaze (with webcam eye-tracking) and cursor position data from 51 fully-remote, crowd-sourced participants who performed the task on their own computer. We applied real-world time-series data segmentation strategies to resolve the self-paced movement sequence into phases of object interaction and rigorously cleaned the webcam eye-tracking data. In this preliminary investigation, we found that: 1) real-world eye-hand coordination patterns persist and adapt in this digital context, and 2) remote, online, cursor-tracking and webcam eye-tracking are useful tools for capturing visuomotor behaviours during this ecologically-valid human-computer interaction task. We discuss how these findings might inform design principles and further investigations into natural behaviours that persist in digital environments.

翻译：现实物体交互中观察到的眼手协调模式是否适用于基于屏幕的数字物体交互？我们将一项现实物体交互任务（在桌面上顺序物理移动杯子）改编为二维屏幕任务（用光标顺序拖放圆形）。我们通过网络摄像头眼动追踪收集了51名完全远程、众包参与者的注视点数据，并利用光标位置数据。我们采用现实时间序列数据分割策略，将自主步调的运动序列解析为物体交互阶段，并对网络摄像头眼动追踪数据进行了严格清洗。在这项初步研究中，我们发现：1）现实眼手协调模式在此数字情境中持续存在并发生适应性调整；2）远程在线光标追踪与网络摄像头眼动追踪是捕捉这种生态效度人机交互任务中视觉运动行为的有效工具。我们讨论了这些发现如何为设计原则提供启示，并推动对数字环境中持续存在的自然行为的进一步研究。