Team interactions are often multisensory, requiring members to pick up on verbal, visual, spatial and body language cues. Multimodal research, research that captures multiple modes of communication such as audio and visual signals, is therefore integral to understanding these multisensory group communication processes. This type of research has gained traction in biomedical engineering and neuroscience, but it is unclear the extent to which communication and management researchers conduct multimodal research. Our study finds that despite its' utility, multimodal research is underutilized in the communication and management literature's. This paper then covers introductory guidelines for creating new multimodal research including considerations for sensors, data integration and ethical considerations.
翻译:团队互动通常涉及多重感官,需要成员捕捉语言、视觉、空间及肢体语言线索。因此,多模态研究——一种捕捉音频与视觉信号等多重沟通模式的研究方法——对于理解这些多感官群体沟通过程至关重要。此类研究已在生物医学工程与神经科学领域获得广泛关注,但尚不明确传播学与管理学研究者开展多模态研究的程度。本研究发现,尽管多模态研究具有实用价值,但在传播学与管理学文献中尚未得到充分利用。本文继而介绍了开展新多模态研究的入门指南,涵盖传感器选择、数据整合及伦理考量等要素。