In recent years, the potential applications of Large Multimodal Models (LMMs) in fields such as healthcare, social psychology, and industrial design have attracted wide research attention, providing new directions for human factors research. For instance, LMM-based smart systems have become novel research subjects of human factors studies, and LMM introduces new research paradigms and methodologies to this field. Therefore, this paper aims to explore the applications, challenges, and future prospects of LMM in the domain of human factors and ergonomics through an expert-LMM collaborated literature review. Specifically, a novel literature review method is proposed, and research studies of LMM-based accident analysis, human modelling and intervention design are introduced. Subsequently, the paper discusses future trends of the research paradigm and challenges of human factors and ergonomics studies in the era of LMMs. It is expected that this study can provide a valuable perspective and serve as a reference for integrating human factors with artificial intelligence.
翻译:近年来,大型多模态模型(LMMs)在医疗健康、社会心理学、工业设计等领域的潜在应用引起了广泛的研究关注,为人因研究提供了新的方向。例如,基于LMM的智能系统已成为人因研究的新对象,同时LMM也为该领域引入了新的研究范式与方法论。为此,本文旨在通过专家与LMM协同的文献综述,探讨LMM在人因与工效学领域的应用、挑战与未来前景。具体而言,本文提出了一种新颖的文献综述方法,并介绍了基于LMM的事故分析、人体建模与干预设计的相关研究。随后,本文讨论了LMM时代下人因与工效学研究范式的未来趋势及面临的挑战。期望本研究能为融合人因学与人工智能提供有价值的视角与参考。