This UIST Vision argues that "touch" input and interaction remains in its infancy when viewed in context of the seen but unnoticed vocabulary of natural human behaviors, activity, and environments that surround direct interaction with displays. Unlike status-quo touch interaction -- a shadowplay of fingers on a single screen -- I argue that our perspective of direct interaction should encompass the full rich context of individual use (whether via touch, sensors, or in combination with other modalities), as well as collaborative activity where people are engaged in local (co-located), remote (tele-present), and hybrid work. We can further view touch through the lens of the "Society of Devices," where each person's activities span many complementary, oft-distinct devices that offer the right task affordance (input modality, screen size, aspect ratio, or simply a distinct surface with dedicated purpose) at the right place and time. While many hints of this vision already exist (see references), I speculate that a comprehensive program of research to systematically inventory, sense, and design interactions around such human behaviors and activities -- and that fully embrace touch as a multi-modal, multi-sensor, multi-user, and multi-device construct -- could revolutionize both individual and collaborative interaction with technology.
翻译:本篇 UIST 愿景论文认为,在包围直接显示交互的“可见却常被忽视”的自然人类行为、活动与环境语境下,“触觉”输入与交互仍处于发展初期。与现状的触觉交互——屏幕上手指的皮影戏——不同,我主张直接交互的视角应涵盖个人使用的完整丰富语境(无论是通过触觉、传感器,或结合其他模态),以及人们从事本地(同地)、远程(远程呈现)及混合工作的协作活动。我们还可通过“设备社会”的视角审视触觉:每个人的活动横跨多个互补且常截然不同的设备,这些设备在正确的时间和地点提供恰当的任务支持(输入模态、屏幕尺寸、宽高比,或仅仅是具有特定用途的独立表面)。尽管这一愿景的诸多迹象已然存在(参见参考文献),我推测若能开展系统性研究计划,对围绕此类人类行为与活动的交互进行编目、感知与设计——并全面将触觉视为一种多模态、多传感器、多用户及多设备的构造——则可能彻底革新个人及协作技术交互。