Automatic group emotion recognition plays an important role in understanding complex human-human interaction. This paper introduces, Emolysis, a standalone open-source toolkit for real-time multimodal group emotion recognition and visualization. Given any input video, Emolysis processes nearly real-time synchronized multimodal input and maps it to group level emotion, valence and arousal. Additionally, the toolkit supports major mobile and desktop platforms (Android, iOS, Windows). The Emolysis platform also comes with an intuitive graphical user interface that allows users to select different modalities and target persons for more fine grained emotion analysis. Emolysis is freely available for academic research, and encourages application developers to extend it to application specific environments on top of the existing system. We believe that the extension mechanism is quite straightforward. Our code and models are available at https://github.com/ControlNet/emolysis.
翻译:自动群体情感识别在理解复杂人际交互中扮演着重要角色。本文介绍了Emolysis,一个用于实时多模态群体情感识别与可视化的独立开源工具包。给定任意输入视频,Emolysis能够处理近乎实时同步的多模态输入,并将其映射至群体层面的情感、效价与唤醒度。此外,该工具包支持主流移动与桌面平台(Android、iOS、Windows)。Emolysis平台还配备直观的图形用户界面,允许用户选择不同模态与目标个体以实现更细粒度的情感分析。Emolysis面向学术研究免费开放,并鼓励应用开发者在现有系统基础上将其扩展至特定应用场景。我们认为这一扩展机制相当直接。我们的代码与模型可通过https://github.com/ControlNet/emolysis获取。