Intentional and accidental harms arising from the use of AI have impacted the health, safety and rights of individuals. While regulatory frameworks are being developed, there remains a lack of consensus on methods necessary to deliver safe AI. The potential for explainable AI (XAI) to contribute to the effectiveness of the regulation of AI is being increasingly examined. Regulation must include methods to ensure compliance on an ongoing basis, though there is an absence of practical proposals on how to achieve this. For XAI to be successfully incorporated into a regulatory system, the individuals who are engaged in interpreting/explaining the model to stakeholders should be sufficiently qualified for the role. Statutory professionals are prevalent in domains in which harm can be done to the health, safety and rights of individuals. The most obvious examples are doctors, engineers and lawyers. Those professionals are required to exercise skill and judgement and to defend their decision making process in the event of harm occurring. We propose that a statutory profession framework be introduced as a necessary part of the AI regulatory framework for compliance and monitoring purposes. We will refer to this new statutory professional as an AI Architect (AIA). This AIA would be responsible to ensure the risk of harm is minimised and accountable in the event that harms occur. The AIA would also be relied on to provide appropriate interpretations/explanations of XAI models to stakeholders. Further, in order to satisfy themselves that the models have been developed in a satisfactory manner, the AIA would require models to have appropriate transparency. Therefore it is likely that the introduction of an AIA system would lead to an increase in the use of XAI to enable AIA to discharge their professional obligations.

翻译：人工智能使用过程中产生的有意和无意伤害已影响到个人的健康、安全与权利。尽管监管框架正在制定中，但关于提供安全AI所需方法仍缺乏共识。可解释人工智能（XAI）对提升AI监管有效性的潜在贡献正受到日益关注。监管必须包含持续确保合规的方法，但目前缺乏实现这一目标的具体方案。要使XAI成功融入监管体系，负责向利益相关者解读/解释模型的个人必须具备充分资质。在可能危害个人健康、安全与权利的领域，法定专业人士普遍存在。最典型的例子是医生、工程师和律师。这些专业人士需运用专业技能与判断力，并在危害发生时为其决策过程辩护。我们建议将法定职业框架作为AI监管体系中合规与监督的必要组成部分引入。我们将这一新法定职业称为AI架构师（AIA）。该AIA将负责确保危害风险最小化，并在危害发生时承担责任。此外，AIA还将承担向利益相关者提供XAI模型适当解读/解释的职责。同时，为确认模型以令人满意的方式开发，AIA需要模型具备适当的透明度。因此，引入AIA体系很可能导致XAI使用增加，以协助AIA履行其职业义务。