This report examines practical challenges in operationalising JSP 936 Part 1 for AI assurance in UK Defence. Using a structured interpretive review of the directive's requirements, the analysis identifies eight thematic challenge areas adequacy of evidence and argument, management of human interaction with AI, definition of the operational environment, integration of AI within systems of systems, assessment and maintenance of AI performance, analysis of safety and security, measurement of ethicality, and mitigation of the inherent complexities of AI. The report argues that JSP 936 provides a useful governance basis, but that implementation depends on unresolved technical, organisational, and assurance questions. These challenges stem from the socio-technical nature of AI-enabled systems, uncertainty in real-world deployment contexts, limitations in current assurance methodologies, and tensions between performance, safety, human oversight, security, and ethical acceptability. The report identifies areas where further methods, guidance, and organisational capability are needed for the ambitious, safe, and responsible adoption of AI across Defence. This is consistent with MOD's own framing of JSP 936 as requiring iterative implementation and supporting guidance.
翻译:本报告探讨了在英国国防领域实施《JSP 936》第一部分对AI进行保障时所面临的实践挑战。通过对该指令要求的结构化解释性审查,分析识别出八个主题挑战领域:证据与论证的充分性、人类与AI交互的管理、作战环境的界定、AI在系统之系统(系统簇)中的集成、AI性能的评估与维护、安全性与安保性分析、伦理性的衡量,以及AI固有复杂性的缓解。报告认为,《JSP 936》提供了有用的治理基础,但其落实取决于尚未解决的技术、组织与保障问题。这些挑战源于AI赋能系统的社会技术特性、实际部署环境的不确定性、当前保障方法的局限性,以及性能、安全性、人类监督、安保性与伦理可接受性之间的张力。报告指出了在哪些领域需要进一步的方法、指南和组织能力,以支持AI在国防领域实现雄心勃勃、安全且负责任的采用。这与英国国防部自身将《JSP 936》定位为需要迭代实施与配套指导的框架是一致的。