The use of AI in healthcare is designed to improve care delivery and augment the decisions of providers to enhance patient outcomes. When deployed in clinical settings, the interaction between providers and AI is a critical component for measuring and understanding the effectiveness of these digital tools on broader health outcomes. Even in cases where AI algorithms have high diagnostic accuracy, healthcare providers often still rely on their experience and sometimes gut feeling to make a final decision. Other times, providers rely unquestioningly on the outputs of the AI models, which leads to a concern about over-reliance on the technology. The purpose of this research was to understand how reliant drug shop dispensers were on AI-powered technologies when determining a differential diagnosis for a presented clinical case vignette. We explored how the drug dispensers responded to technology that is framed as always correct in an attempt to measure whether they begin to rely on it without any critical thought of their own. We found that dispensers relied on the decision made by the AI 25 percent of the time, even when the AI provided no explanation for its decision.

翻译：人工智能在医疗领域的应用旨在改善诊疗服务、增强医疗服务提供者的决策能力，从而提升患者预后。当这些工具被部署到临床环境中时，医疗服务提供者与AI之间的互动成为衡量和理解数字工具对整体健康结果有效性的关键要素。即便在AI算法诊断准确率较高的情况下，医疗服务提供者仍常依赖自身经验甚至直觉做出最终决策。有时，提供者会不加质疑地依赖AI模型的输出结果，由此引发对技术过度依赖的担忧。本研究旨在探究药品发放者在面对临床案例的鉴别诊断时，对AI驱动技术的依赖程度。我们通过观察药品发放者对设定为"始终正确"的技术的反应，评估其是否会在缺乏独立思考的情况下依赖该技术。研究发现，即使AI未提供任何决策依据，发放者在25%的情况下仍会遵从AI的决策。