An autonomous system is constructed by a manufacturer, operates in a society subject to norms and laws, and interacts with end users. All of these actors are stakeholders affected by the behavior of the autonomous system. We address the challenge of how the ethical views of such stakeholders can be integrated in the behavior of an autonomous system. We propose an ethical recommendation component called Jiminy which uses techniques from normative systems and formal argumentation to reach moral agreements among stakeholders. A Jiminy represents the ethical views of each stakeholder by using normative systems, and has three ways of resolving moral dilemmas that involve the opinions of the stakeholders. First, the Jiminy considers how the arguments of the stakeholders relate to one another, which may already resolve the dilemma. Secondly, the Jiminy combines the normative systems of the stakeholders such that the combined expertise of the stakeholders may resolve the dilemma. Thirdly, and only if these two other methods have failed, the Jiminy uses context-sensitive rules to decide which of the stakeholders take preference over the others. At the abstract level, these three methods are characterized by adding arguments, adding attacks between arguments, and revising attacks between arguments. We show how a Jiminy can be used not only for ethical reasoning and collaborative decision-making, but also to provide explanations about ethical behavior.
翻译:自治系统由制造商构建,运行于受规范和法律约束的社会中,并与终端用户互动。所有这些行动者都是受自治系统行为影响的利益相关者。我们探讨如何将这些利益相关者的伦理观点整合到自治系统行为中的挑战。我们提出一个名为吉米尼的伦理推荐组件,该组件运用规范系统与形式论证技术,在利益相关者之间达成道德共识。吉米尼通过规范系统表征每位利益相关者的伦理观点,并采用三种方式解决涉及利益相关者意见的道德困境:首先,吉米尼分析利益相关者论据之间的关联,这种方式可能直接解决困境;其次,吉米尼整合各利益相关者的规范系统,通过汇聚多方专业知识化解困境;最后,仅当前述两种方法失效时,吉米尼运用语境敏感规则判定哪些利益相关者应获得优先考量。在抽象层面,这三种方法分别对应新增论据、新增论据间的攻击关系以及修正论据间的攻击关系。我们展示吉米尼不仅可用于伦理推理与协作决策,还能提供关于伦理行为的解释。