This paper introduces Stringesthesia, an interactive and improvised performance paradigm. Stringesthesia uses real-time neuroimaging to connect performers and audiences, enabling direct access to the performers mental state and determining audience participation during the performance. Functional near-infrared spectroscopy, or fNIRS, a noninvasive neuroimaging tool, was used to assess metabolic activity of brain areas collectively associated with a metric we call trust. A visualization representing the real-time measurement of the performers level of trust was projected behind the performer and used to dynamically restrict or promote audience participation. Throughout the paper we discuss prior work that heavily influenced our design, conceptual and methodological issues with using fNIRS technology, system architecture, and feedback from the audience and performer.

翻译：摘要：本文介绍了Stringesthesia——一种交互式即兴表演范式。该范式利用实时神经影像技术连接表演者与观众，使得观众能够直接感知表演者的心理状态，并在表演过程中决定观众的参与程度。研究采用了功能性近红外光谱成像（fNIRS）这一无创神经影像工具，评估大脑区域的代谢活动，这些区域共同关联于我们称之为“信任”的指标。一个代表表演者信任水平实时测量的可视化图像被投射在表演者身后，用于动态限制或促进观众的参与。全文讨论了深刻影响我们设计的先前工作、fNIRS技术应用中的概念与方法论问题、系统架构，以及来自观众和表演者的反馈。