This study explores the integration of auditory and tactile experiences in musical haptics, focusing on enhancing sensory dimensions of music through touch. Addressing the gap in translating auditory signals to meaningful tactile feedback, our research introduces a novel method involving a touch-sensitive recorder and a wearable haptic display that captures musical interactions via force sensors and converts these into tactile sensations. Previous studies have shown the potential of haptic feedback to enhance musical expressivity, yet challenges remain in conveying complex musical nuances. Our method aims to expand music accessibility for individuals with hearing impairments and deepen digital musical interactions. Experimental results reveal high accuracy ($98\%$ without noise, 93% with white noise) in melody recognition through tactile feedback, demonstrating effective transmission and perception of musical information. The findings highlight the potential of haptic technology to bridge sensory gaps, offering significant implications for music therapy, education, and remote musical collaboration, advancing the field of musical haptics and multi-sensory technology applications.
翻译:本研究探索了音乐触觉中听觉与触觉体验的融合,重点通过触觉增强音乐的多感官维度。针对将听觉信号转化为有意义触觉反馈的研究空白,我们提出了一种创新方法,该方法采用触敏记录器与可穿戴触觉显示器,通过力传感器捕捉音乐交互并将其转化为触觉感知。先前研究已表明触觉反馈在提升音乐表现力方面的潜力,但在传达复杂音乐细微差别方面仍存在挑战。我们的方法旨在扩展听力受损人群的音乐可及性,并深化数字音乐交互体验。实验结果表明,通过触觉反馈进行旋律识别的准确率较高(无噪声条件下达$98\%$,白噪声条件下为93%),证明了音乐信息传输与感知的有效性。这些发现凸显了触觉技术在弥合感官鸿沟方面的潜力,对音乐治疗、音乐教育及远程音乐协作具有重要启示,推动了音乐触觉学及多感官技术应用领域的发展。