Threat modeling is a popular method to securely develop systems by achieving awareness of potential areas of future damage caused by adversaries. The benefit of threat modeling lies in its ability to indicate areas of concern, paving the way to consider mitigation during the design stage. However, threat modeling for systems relying on Artificial Intelligence is still not well explored. While conventional threat modeling methods and tools did not address AI-related threats, research on this amalgamation still lacks solutions capable of guiding and automating the process, as well as providing evidence that the methods hold up in practice. To evaluate that the work at hand is able to guide and automatically identify AI-related threats during the architecture definition stage, several experts were tasked to create a threat model of an AI system designed in the healthcare domain. The usability of the solution was well-perceived, and the results indicate that it is effective for threat identification.

翻译：威胁建模是一种通过识别对手可能造成的潜在损害区域，从而安全开发系统的流行方法。其优势在于能够指出需关注的领域，为在设计阶段考虑缓解措施奠定基础。然而，依赖人工智能系统的威胁建模尚未得到充分探索。尽管传统威胁建模方法和工具未能处理与AI相关的威胁，但针对这一融合领域的研究仍缺乏能够指导并自动化该过程的解决方案，以及证明这些方法在实践中行之有效的证据。为评估当前工作能否在架构定义阶段指导并自动识别AI相关威胁，多名专家受命对医疗领域设计的AI系统创建威胁模型。该解决方案的易用性获得良好反馈，结果表明其在威胁识别方面具有有效性。