The integration of machine learning (ML) into cyber-physical systems (CPS) offers significant benefits, including enhanced efficiency, predictive capabilities, real-time responsiveness, and the enabling of autonomous operations. This convergence has accelerated the development and deployment of a range of real-world applications, such as autonomous vehicles, delivery drones, service robots, and telemedicine procedures. However, the software development life cycle (SDLC) for AI-infused CPS diverges significantly from traditional approaches, featuring data and learning as two critical components. Existing verification and validation techniques are often inadequate for these new paradigms. In this study, we pinpoint the main challenges in ensuring formal safety for learningenabled CPS.We begin by examining testing as the most pragmatic method for verification and validation, summarizing the current state-of-the-art methodologies. Recognizing the limitations in current testing approaches to provide formal safety guarantees, we propose a roadmap to transition from foundational probabilistic testing to a more rigorous approach capable of delivering formal assurance.

翻译：将机器学习（ML）融入信息物理系统（CPS）带来了显著优势，包括增强效率、预测能力、实时响应性以及实现自主操作，进而加速了自动驾驶汽车、配送无人机、服务机器人和远程医疗程序等一系列实际应用的开发与部署。然而，人工智能赋能的信息物理系统的软件开发生命周期与传统方法存在显著差异，其中数据和学习成为两个关键组成部分。现有的验证与确认技术往往不足以应对这些新范式。本研究首先识别了确保学习型信息物理系统形式化安全性的主要挑战，从测试作为最实用的验证与确认方法入手，总结了当前最先进的方法论。鉴于现有测试方法在提供形式化安全保证方面的局限性，我们提出了一条从基础概率测试过渡到能够提供形式化保证的更严谨方法的路线图。