Purpose: A fundamental problem in designing safe machine learning systems is identifying when samples presented to a deployed model differ from those observed at training time. Detecting so-called out-of-distribution (OoD) samples is crucial in safety-critical applications such as robotically-guided retinal microsurgery, where distances between the instrument and the retina are derived from sequences of 1D images that are acquired by an instrument-integrated optical coherence tomography (iiOCT) probe. Methods: This work investigates the feasibility of using an OoD detector to identify when images from the iiOCT probe are inappropriate for subsequent machine learning-based distance estimation. We show how a simple OoD detector based on the Mahalanobis distance can successfully reject corrupted samples coming from real-world ex-vivo porcine eyes. Results: Our results demonstrate that the proposed approach can successfully detect OoD samples and help maintain the performance of the downstream task within reasonable levels. MahaAD outperformed a supervised approach trained on the same kind of corruptions and achieved the best performance in detecting OoD cases from a collection of iiOCT samples with real-world corruptions. Conclusion: The results indicate that detecting corrupted iiOCT data through OoD detection is feasible and does not need prior knowledge of possible corruptions. Consequently, MahaAD could aid in ensuring patient safety during robotically-guided microsurgery by preventing deployed prediction models from estimating distances that put the patient at risk.
翻译:目的:在设计安全机器学习系统时,一个基本问题是如何识别部署模型所接收的样本与训练时观察到的样本存在差异。检测所谓的分布外(OoD)样本在安全关键型应用(如机器人辅助视网膜显微手术)中至关重要,在此类手术中,器械与视网膜之间的距离是通过器械集成光学相干断层扫描(iiOCT)探头获取的一维图像序列推导得出的。方法:本研究探究了使用OoD检测器识别iiOCT探头图像是否不适用于后续基于机器学习的距离估计的可行性。我们展示了基于马氏距离的简单OoD检测器如何成功拒绝来自真实世界离体猪眼的受污染样本。结果:我们的结果表明,所提出的方法能够成功检测出OoD样本,并有助于将下游任务的性能维持在合理水平。MahaAD在检测同类污染上的监督学习方案中表现更优,并在包含真实世界污染的一批iiOCT样本中取得了最佳的OoD案例检测性能。结论:结果表明,通过OoD检测识别受污染的iiOCT数据具有可行性,且无需事先了解可能的污染类型。因此,MahaAD可通过防止部署的预测模型估计危及患者安全的距离,帮助确保机器人辅助显微手术中患者的安全性。