The collaboration between humans and artificial intelligence (AI) is a significant feature in this digital age. However, humans and AI may have observation, interpretation, and action conflicts when working synchronously. This phenomenon is often masked by faults and, unfortunately, overlooked. This paper systematically introduces the human-AI conflict concept, causes, measurement methods, and risk assessment. The results highlight that there is a potential second decision-maker besides the human, which is the AI; the human-AI conflict is a unique and emerging risk in digitalized process systems; and this is an interdisciplinary field that needs to be distinguished from traditional fault and failure analysis; the conflict risk is significant and cannot be ignored.
翻译:人类与人工智能(AI)之间的协同是数字化时代的重要特征。然而,当人类与AI同步工作时,可能在观察、解释和行动层面产生冲突。这一现象常被故障所掩盖,且令人遗憾的是,经常受到忽视。本文系统性地介绍了人机冲突的概念、成因、测量方法及风险评估。研究结果表明:人类之外存在潜在的第二个决策者,即AI;人机冲突是数字化流程系统中一种独特且新兴的风险;这是一个需要与传统故障和失效分析相区分的跨学科领域;冲突风险显著且不容忽视。