Music performance is a distinctly human activity, intrinsically linked to the performer's ability to convey, evoke, or express emotion. Machines cannot perform music in the human sense; they can produce, reproduce, execute, or synthesize music, but they lack the capacity for affective or emotional experience. As such, music performance is an ideal candidate through which to explore aspects of collaboration between humans and machines. In this paper, we introduce the witheFlow system, designed to enhance real-time music performance by automatically modulating audio effects based on features extracted from both biosignals and the audio itself. The system, currently in a proof-of-concept phase, is designed to be lightweight, able to run locally on a laptop, and is open-source given the availability of a compatible Digital Audio Workstation and sensors.
翻译:音乐表演是一种独特的人类活动,其本质与表演者传达、唤起或表达情感的能力密不可分。机器无法以人类的意义上的“表演”音乐,它们可以制作、再现、执行或合成音乐,但缺乏情感体验的能力。因此,音乐表演是探索人机协作的理想场景。本文介绍了witheFlow系统,旨在通过自动调制基于生物信号和音频本身提取特征的音频效果,增强实时音乐表演。该系统目前处于概念验证阶段,设计轻量级,可在一台笔记本电脑上本地运行,并在兼容的数字音频工作站和传感器支持下开源。