With the growing prevalence of machine learning and artificial intelligence-based medical decision support systems, it is equally important to ensure that these systems provide patient outcomes in a fair and equitable fashion. This paper presents an innovative framework for detecting areas of algorithmic bias in medical-AI decision support systems. Our approach efficiently identifies potential biases in medical-AI models, specifically in the context of sepsis prediction, by employing the Classification and Regression Trees (CART) algorithm. We verify our methodology by conducting a series of synthetic data experiments, showcasing its ability to estimate areas of bias in controlled settings precisely. The effectiveness of the concept is further validated by experiments using electronic medical records from Grady Memorial Hospital in Atlanta, Georgia. These tests demonstrate the practical implementation of our strategy in a clinical environment, where it can function as a vital instrument for guaranteeing fairness and equity in AI-based medical decisions.

翻译：随着基于机器学习和人工智能的医疗决策支持系统的日益普及，确保这些系统以公平公正的方式提供患者预后同样至关重要。本文提出了一种创新框架，用于检测医疗AI决策支持系统中存在的算法偏见区域。我们的方法通过采用分类与回归树（CART）算法，高效识别医疗AI模型中的潜在偏见，具体聚焦于脓毒症预测场景。我们通过一系列合成数据实验验证了该方法论，展示了其在受控条件下精确估计偏见区域的能力。该概念的有效性进一步通过使用佐治亚州亚特兰大格雷迪纪念医院的电子病历实验得到验证。这些测试证明了该策略在临床环境中的实际应用价值，可作为保障基于AI的医疗决策公平与正义的关键工具。