This work proposes an interactive art installation "Mood spRing" designed to reflect the mood of the environment through interpretation of language and tone. Mood spRing consists of an AI program that controls an immersive 3D animation of the seasons. If the AI program perceives the language and tone of the users as pleasant, the animation progresses through idealized renditions of seasons. Otherwise, it slips into unpleasant weather and natural disasters of the season. To interpret the language and tone of the user interaction, hybrid state-of-the-art emotion detection methods are applied to the user audio and text inputs. The emotional states detected separately from tone and language are fused by a novel approach that aims at minimizing the possible model disparity across diverse demographic groups.
翻译:本工作提出了一种名为"Mood spRing"的交互式艺术装置,旨在通过语言与语调的分析来反映环境情感。该装置包含一个控制沉浸式季节三维动画的人工智能程序:当程序感知到用户的语言与语调愉悦时,动画将呈现理想化的季节场景;反之则转为该季节的恶劣天气与自然灾害。为解读用户交互中的语言与语调,系统将混合应用最先进的情感检测方法处理用户音频和文本输入。通过一种旨在最小化不同人口群体间模型差异性的新型融合方法,分别从语调与语言中检测的情感状态得以整合。