Artificial intelligence (AI) reasoning and explainable AI (XAI) tasks have gained popularity recently, enabling users to explain the predictions or decision processes of AI models. This paper introduces Forest Monkey (FM), a toolkit designed to reason the outputs of any AI-based defect detection and/or classification model with data explainability. Implemented as a Python package, FM takes input in the form of dataset folder paths (including original images, ground truth labels, and predicted labels) and provides a set of charts and a text file to illustrate the reasoning results and suggest possible improvements. The FM toolkit consists of processes such as feature extraction from predictions to reasoning targets, feature extraction from images to defect characteristics, and a decision tree-based AI-Reasoner. Additionally, this paper investigates the time performance of the FM toolkit when applied to four AI models with different datasets. Lastly, a tutorial is provided to guide users in performing reasoning tasks using the FM toolkit.
翻译:人工智能(AI)推理与可解释人工智能(XAI)任务近年来日益受到关注,使用户能够解释AI模型的预测或决策过程。本文介绍了Forest Monkey(FM),一个旨在对任意基于AI的缺陷检测和/或分类模型的输出进行数据可解释性推理的工具包。FM以Python包形式实现,输入为数据集文件夹路径(包括原始图像、真实标签和预测标签),并输出一系列图表及一个文本文件,用于展示推理结果并提出可能的改进建议。FM工具包包含以下流程:从预测结果到推理目标的特征提取、从图像到缺陷特征的特征提取,以及基于决策树的AI推理器。此外,本文研究了FM工具包在四个不同数据集上的AI模型中的时间性能。最后,提供了使用FM工具包执行推理任务的教程指南。