Clinical needs and technological advances have resulted in increased use of Artificial Intelligence (AI) in clinical decision support. However, such support can introduce new and amplify existing cognitive biases. Through contextual inquiry and interviews, we set out to understand the use of an existing AI support system by ophthalmologists. We identified concerns regarding anchoring bias and a misunderstanding of the AI's capabilities. Following, we evaluated clinicians' perceptions of three bias mitigation strategies as integrated into their existing decision support system. While clinicians recognised the danger of anchoring bias, we identified a concern around the impact of bias mitigation on procedure time. Our participants were divided in their expectations of any positive impact on diagnostic accuracy, stemming from varying reliance on the decision support. Our results provide insights into the challenges of integrating bias mitigation into AI decision support.
翻译:临床需求和技术进步导致人工智能(AI)在临床决策支持中的应用日益广泛。然而,此类支持可能引入新的认知偏见或放大现有的认知偏见。通过情境调查与访谈,我们旨在了解眼科医生对现有AI支持系统的使用情况。我们识别出对锚定偏见的担忧以及对AI能力的误解。随后,我们评估了临床医生对三种集成至现有决策支持系统的偏见缓解策略的认知。尽管临床医生认识到锚定偏见的危险性,但我们发现其对缓解策略可能延长操作时间存在顾虑。受试者对缓解策略能否提升诊断准确率的预期存在分歧,这源于其对决策支持系统的依赖程度各异。我们的研究结果为理解将偏见缓解融入AI决策支持的挑战提供了洞见。