We propose a design space for data melodification, where standard visualization idioms and fundamental data characteristics map to rhetorical devices of music for a more affective experience of data. Traditional data sonification transforms data into sound by mapping it to different parameters such as pitch, volume, and duration. Often and regrettably, this mapping leaves behind melody, harmony, rhythm and other musical devices that compose the centuries-long persuasive and expressive power of music. What results is the occasional, unintentional sense of tinnitus and horror film-like impending doom caused by a disconnect between the semantics of data and sound. Through this work we ask, can the aestheticization of sonification through (classical) music theory make data simultaneously accessible, meaningful, and pleasing to one's ears?
翻译:我们提出了一个数据旋律化的设计空间,其中标准可视化习语和基本数据特征映射到音乐修辞手法,以实现更具情感体验的数据呈现。传统数据可听化通过将数据映射到音高、音量、时长等不同参数来将数据转化为声音。遗憾的是,这种映射常常忽略了旋律、和声、节奏以及其他构成音乐数百年来说服力与表现力的音乐手法,导致数据语义与声音之间的脱节时而引发偶发的、非刻意的耳鸣感及恐怖电影般的末日迫近感。本研究探讨:通过(古典)音乐理论实现可听化的审美化,能否使数据同时具备可理解性、意义性及听觉愉悦性?