In this paper, we propose Evidential Conformal Prediction (ECP) method for image classifiers to generate the conformal prediction sets. Our method is designed based on a non-conformity score function that has its roots in Evidential Deep Learning (EDL) as a method of quantifying model (epistemic) uncertainty in DNN classifiers. We use evidence that are derived from the logit values of target labels to compute the components of our non-conformity score function: the heuristic notion of uncertainty in CP, uncertainty surprisal, and expected utility. Our extensive experimental evaluation demonstrates that ECP outperforms three state-of-the-art methods for generating CP sets, in terms of their set sizes and adaptivity while maintaining the coverage of true labels.
翻译:本文提出了一种用于图像分类器的证据符合性预测方法,以生成符合性预测集合。该方法基于非一致性评分函数设计,该函数源于证据深度学习——一种用于量化深度神经网络分类器中模型认知不确定性的方法。我们利用从目标标签的logit值推导出的证据来计算非一致性评分函数的三个组成部分:符合性预测中的启发式不确定性概念、不确定性惊奇度以及期望效用。大量实验评估表明,在保持真实标签覆盖率的前提下,本方法在集合规模与自适应性方面均优于当前三种最先进的符合性预测集合生成方法。