Powered by the increasing predictive capabilities of machine learning algorithms, artificial intelligence (AI) systems have begun to be used to overrule human mistakes in many settings. We provide the first field evidence this AI oversight carries psychological costs that can impact human decision-making. We investigate one of the highest visibility settings in which AI oversight has occurred: the Hawk-Eye review of umpires in top tennis tournaments. We find that umpires lowered their overall mistake rate after the introduction of Hawk-Eye review, in line with rational inattention given psychological costs of being overruled by AI. We also find that umpires increased the rate at which they called balls in, which produced a shift from making Type II errors (calling a ball out when in) to Type I errors (calling a ball in when out). We structurally estimate the psychological costs of being overruled by AI using a model of rational inattentive umpires, and our results suggest that because of these costs, umpires cared twice as much about Type II errors under AI oversight.
翻译:随着机器学习算法预测能力的增强,人工智能系统已开始被用于纠正许多场景中的人为错误。我们首次提供实地证据表明,这种人工智能监督会带来心理成本,从而影响人类决策。我们研究了人工智能监督最受关注的场景之一:顶级网球赛事中鹰眼系统对裁判的复核机制。研究发现,引入鹰眼复核后,裁判的整体错误率下降——这与理性疏忽理论一致,即考虑到被人工智能推翻判决的心理成本。同时,裁判倾向于更频繁地将球判为界内,导致错误类型从第二类错误(界内球误判为界外)向第一类错误(界外球误判为界内)转变。我们通过构建理性疏忽裁判模型,结构性地估算了被人工智能推翻判决的心理成本,结果表明,由于这些成本的存在,在人工智能监督下裁判对第二类错误的重视程度提高了两倍。