Powered by the increasing predictive capabilities of machine learning algorithms, artificial intelligence (AI) systems have begun to be used to overrule human mistakes in many settings. We provide the first field evidence this AI oversight carries psychological costs that can impact human decision-making. We investigate one of the highest visibility settings in which AI oversight has occurred: the Hawk-Eye review of umpires in top tennis tournaments. We find that umpires lowered their overall mistake rate after the introduction of Hawk-Eye review, in line with rational inattention given psychological costs of being overruled by AI. We also find that umpires increased the rate at which they called balls in, which produced a shift from making Type II errors (calling a ball out when in) to Type I errors (calling a ball in when out). We structurally estimate the psychological costs of being overruled by AI using a model of rational inattentive umpires, and our results suggest that because of these costs, umpires cared twice as much about Type II errors under AI oversight.
翻译:基于机器学习算法不断增强的预测能力,人工智能系统已开始被用于纠正许多场景中的人类错误。我们首次提供现场证据表明,这种AI监督会带来影响人类决策的心理成本。我们研究了AI监督最高可见度的场景之一:顶级网球赛事中鹰眼系统对裁判的复核。我们发现,引入鹰眼复核后,裁判的总体错误率下降,这符合理性疏忽理论——考虑到被AI推翻判决的心理成本。我们还发现,裁判在判定界内球的比率上升,这导致第二类错误(将界内球判为出界)向第一类错误(将出界球判为界内)的转变。我们采用理性疏忽裁判模型,对AI推翻裁判判决的心理成本进行了结构估计,结果表明由于这些成本的存在,在AI监督下裁判对第二类错误的重视程度提升至两倍。