In systems with advanced automation, human responsibility for outcomes becomes equivocal. We developed the Responsibility Quantification (ResQu) model to compute a measure of operator responsibility (Douer & Meyer, 2020) and compared it to observed and subjective levels of responsibility (Douer & Meyer, 2019). We used the model to calculate operators' objective responsibility in a common fault event in the control room in a dairy factory. We compared the results to the subjective assessments made by different functions in the diary. The capabilities of the automation greatly exceeded those of the human, and the operator should comply with the indications of the automation. Thus, the objective causal human responsibility is 0. Outside observers, such as managers, assigned much higher responsibility to the operator, possibly holding operators responsible for adverse outcomes in situations in which they rightly trusted the automation.
翻译:在具有高级自动化水平的系统中,人类对结果的责任变得模糊不清。我们开发了责任量化(ResQu)模型来计算操作者责任指标(Douer & Meyer, 2020),并将其与观察到的和主观的责任水平进行了比较(Douer & Meyer, 2019)。我们利用该模型计算了乳制品工厂控制室中常见故障事件里操作者的客观责任,并将结果与不同职能部门做出的主观评估进行了对比。自动化系统的能力远超人类,操作者应遵循自动化系统的指示。因此,操作者的客观因果责任为0。而外部观察者(如管理者)却将远高于此的责任归于操作者,这可能是在操作者合理信任自动化系统的情况下,仍然让其对不良后果负责。