The concept of rationality is central to the field of artificial intelligence. Whether we are seeking to simulate human reasoning, or the goal is to achieve bounded optimality, we generally seek to make artificial agents as rational as possible. Despite the centrality of the concept within AI, there is no unified definition of what constitutes a rational agent. This article provides a survey of rationality and irrationality in artificial intelligence, and sets out the open questions in this area. The understanding of rationality in other fields has influenced its conception within artificial intelligence, in particular work in economics, philosophy and psychology. Focusing on the behaviour of artificial agents, we consider irrational behaviours that can prove to be optimal in certain scenarios. Some methods have been developed to deal with irrational agents, both in terms of identification and interaction, however work in this area remains limited. Methods that have up to now been developed for other purposes, namely adversarial scenarios, may be adapted to suit interactions with artificial agents. We further discuss the interplay between human and artificial agents, and the role that rationality plays within this interaction; many questions remain in this area, relating to potentially irrational behaviour of both humans and artificial agents.
翻译:理性概念是人工智能领域的核心。无论我们旨在模拟人类推理,还是追求有限最优性,通常都希望使人工代理尽可能理性。尽管理性概念在AI中占据核心地位,但目前对理性代理尚未形成统一定义。本文系统梳理了人工智能中的理性与非理性研究,并提出了该领域的开放性问题。其他学科对理性的理解影响了其在人工智能中的概念构建,特别是经济学、哲学和心理学的研究。聚焦于人工代理的行为,我们分析了在某些场景下可能证明为最优的非理性行为。目前已有部分方法被开发用于处理非理性代理(包括识别与交互),但该领域研究仍十分有限。此前为其他目的(如对抗性场景)开发的方法或可被改造用于与人工代理的交互。我们进一步探讨了人类与人工代理之间的互动,以及理性在这一互动中的作用;这一领域仍存在诸多与人机双方潜在非理性行为相关的未解问题。