Despite the significant success of deep learning models in computer vision, they often exhibit systematic failures on specific data subsets, known as error slices. Identifying and mitigating these error slices is crucial to enhancing model robustness and reliability in real-world scenarios. In this paper, we introduce HiBug2, an automated framework for error slice discovery and model repair. HiBug2 first generates task-specific visual attributes to highlight instances prone to errors through an interpretable and structured process. It then employs an efficient slice enumeration algorithm to systematically identify error slices, overcoming the combinatorial challenges that arise during slice exploration. Additionally, HiBug2 extends its capabilities by predicting error slices beyond the validation set, addressing a key limitation of prior approaches. Extensive experiments across multiple domains, including image classification, pose estimation, and object detection - show that HiBug2 not only improves the coherence and precision of identified error slices but also significantly enhances the model repair capabilities.
翻译:尽管深度学习模型在计算机视觉领域取得了显著成功,但它们往往在特定数据子集上表现出系统性故障,这些子集被称为错误切片。识别并缓解这些错误切片对于提升模型在现实场景中的鲁棒性和可靠性至关重要。本文提出HiBug2,一种用于错误切片发现与模型修复的自动化框架。HiBug2首先通过可解释的结构化过程生成任务相关的视觉属性,以突出易出错实例;随后采用高效的切片枚举算法系统性地识别错误切片,克服了切片探索过程中出现的组合爆炸挑战。此外,HiBug2通过预测验证集之外的数据错误切片,扩展了其能力,解决了先前方法的一个关键局限。在图像分类、姿态估计和目标检测等多个领域的广泛实验表明,HiBug2不仅提升了所识别错误切片的一致性与精确度,还显著增强了模型修复能力。