Safety and assurance cases risk becoming detached from the understanding needed for responsible engineering and governance decisions. More broadly, the production and evaluation of critical socio-technical systems increasingly face an understanding challenge: pressures for increased tempo, reduced scrutiny, software complexity, and growing use of AI generated artefacts may produce outputs that appear coherent without supporting genuine human comprehension. We argue that understanding should become an explicit, assessable, and defensible component of decision making: what developers, assessors, and decision makers grasp about system behavior, evidence, assumptions, risks, and residual uncertainty. Drawing on Catherine Elgin's epistemology of understanding, we outline a conceptual foundation and then use Assurance 2.0 as an engineering route to operationalize using structured argumentation, evidence, confidence, defeaters, and theory based automation. This leads to two linked artefacts: an Understanding Basis, which justifies why available understanding is sufficient for a decision, and a Personal Understanding Statement, through which participants make their grasp explicit and challengeable. We also identify risks that automation may improve artefact production while weakening understanding, and we propose initial directions for evaluating both efficacy and epistemic impact.
翻译:安全与保障论证可能脱离负责任工程与治理决策所需的理解基础。更广泛而言,关键社会技术系统的开发与评估正日益面临理解挑战:对加速进程、降低审查力度、软件复杂性以及日益增多的AI生成产物的需求,可能产出看似连贯却缺乏真正人工理解的输出结果。我们认为,理解应成为决策中显性化、可评估且可辩护的组成部分——关乎开发者、评估者与决策者对系统行为、证据、假设、风险及残余不确定性的掌握程度。借鉴凯瑟琳·埃尔金的认知论体系,我们首先构建概念基础,继而以Assurance 2.0为工程路径,通过结构化论证、证据、置信度、反证因素及基于理论的自动化实现具体操作。由此产生两个关联产物:理解依据文档(阐明现有理解足以支撑决策的逻辑),以及个人理解声明(使参与者的认知状态显性化并接受质疑)。研究同时揭示自动化可能引发的风险——在提升产物质量的同时弱化实际理解,并针对功效与认知影响的双重评估提出初步方向。