Interacting with data visualizations without an instrument or touch surface is typically characterized by the use of mid-air hand gestures. While mid-air expressions can be quite intuitive for interacting with digital content at a distance, they frequently lack precision and necessitate a different way of expressing users' data-related intentions. In this work, we aim to identify new designs for mid-air hand gesture manipulations that can facilitate instrument-free, touch-free, and embedded interactions with visualizations, while utilizing the three-dimensional (3D) interaction space that mid-air gestures afford. We explore mid-air hand gestures for data visualization by searching for natural means to interact with content. We employ three studies - an Elicitation Study, a User Study, and an Expert Study, to provide insight into the users' mental models, explore the design space, and suggest considerations for future mid-air hand gesture design. In addition to forming strong associations with physical manipulations, we discovered that mid-air hand gestures can: promote space-multiplexed interaction, which allows for a greater degree of expression; play a functional role in visual cognition and comprehension; and enhance creativity and engagement. We further highlight the challenges that designers in this field may face to help set the stage for developing effective gestures for a wide range of touchless interactions with visualizations.
翻译:与数据可视化交互时,无工具或触摸表面的场景通常通过空中手势实现。尽管空中手势在远距离数字内容交互中具有直观性,但其精准度往往不足,且需采用不同方式表达用户的数据相关意图。本研究旨在设计新型空中手势操作方案,在利用三维(3D)交互空间优势的同时,实现无工具、无接触、嵌入式的可视化交互。通过探寻与内容交互的自然方式,我们针对数据可视化中的空中手势展开研究。采用启发式研究、用户研究与专家研究三项实验,深度解析用户心智模型、探索设计空间,并为未来空中手势设计提出考量建议。研究发现,除与物理操作形成强关联外,空中手势还能:促进空间复用式交互(提升表达维度)、在视觉认知与理解中发挥功能作用、增强创造性与参与度。我们进一步强调该领域设计师可能面临的挑战,为开发适用于广泛无接触可视化交互场景的有效手势奠定基础。