Tangible interactions involve multiple sensory cues, enabling the accurate perception of object properties, such as size. Research has shown, however, that if we decouple these cues (for example, by altering the visual cue), then the resulting discrepancies present new opportunities for interactions. Perception over time though, not only relies on momentary sensory cues, but also on a priori beliefs about the object, implying a continuing update cycle. This cycle is poorly understood and its impact on interaction remains unknown. We study (N=80) visuo-haptic perception of size over time and (a) reveal how perception drifts, (b) examine the effects of visual priming and dead-reckoning, and (c) present a model of visuo-haptic perception as a cyclical, self-adjusting system. Our work has a direct impact on illusory perception in VR, but also sheds light on how our visual and haptic systems cooperate and diverge.
翻译:有形交互涉及多种感官线索,使得我们能够准确感知物体属性(如尺寸)。然而,研究表明,若将这些线索解耦(例如通过改变视觉线索),由此产生的差异将为交互带来新的可能性。然而,随时间推移的感知不仅依赖于瞬时的感官线索,还依赖于对物体的先验信念,这意味着存在一个持续的更新循环。目前对这一循环的理解尚不充分,其对交互的影响也仍不明确。我们通过实验(N=80)研究了随时间变化的视觉-触觉尺寸感知,并(a)揭示了感知如何发生漂移,(b)检验了视觉启动和航位推算的影响,以及(c)提出了一个将视觉-触觉感知建模为循环自调整系统的模型。我们的工作不仅对虚拟现实中的错觉感知具有直接影响,同时也揭示了视觉与触觉系统如何协同工作与产生分歧。