In settings where users are both time-pressured and need high accuracy, such as doctors working in Emergency Rooms, we want to provide AI assistance that both increases accuracy and reduces time. However, different types of AI assistance have different benefits: some reduce time taken while increasing overreliance on AI, while others do the opposite. We therefore want to adapt what AI assistance we show depending on various properties (of the question and of the user) in order to best tradeoff our two objectives. We introduce a study where users have to prescribe medicines to aliens, and use it to explore the potential for adapting AI assistance. We find evidence that it is beneficial to adapt our AI assistance depending on the question, leading to good tradeoffs between time taken and accuracy. Future work would consider machine-learning algorithms (such as reinforcement learning) to automatically adapt quickly.
翻译:在用户既面临时间压力又需高准确率的场景中(如急诊室工作的医生),我们希望提供既能提升准确率又能缩短时间的AI辅助。然而,不同类型的AI辅助具有不同优势:有的能减少耗时但增加对AI的过度依赖,有的则相反。因此,我们需要根据(问题与用户的)多种属性动态调整所展示的AI辅助,以在双重目标间达成最优权衡。我们设计了一项用户需为外星人开具处方的实验,并借此探索AI辅助的自适应潜力。研究证据表明,根据问题特性调整AI辅助具有显著优势,能有效平衡耗时与准确率。未来工作将考虑采用机器学习算法(如强化学习)实现快速自动适配。