The concept of rationality is central to the field of artificial intelligence. Whether we are seeking to simulate human reasoning, or the goal is to achieve bounded optimality, we generally seek to make artificial agents as rational as possible. Despite the centrality of the concept within AI, there is no unified definition of what constitutes a rational agent. This article provides a survey of rationality and irrationality in artificial intelligence, and sets out the open questions in this area. The understanding of rationality in other fields has influenced its conception within artificial intelligence, in particular work in economics, philosophy and psychology. Focusing on the behaviour of artificial agents, we consider irrational behaviours that can prove to be optimal in certain scenarios. Some methods have been developed to deal with irrational agents, both in terms of identification and interaction, however work in this area remains limited. Methods that have up to now been developed for other purposes, namely adversarial scenarios, may be adapted to suit interactions with artificial agents. We further discuss the interplay between human and artificial agents, and the role that rationality plays within this interaction; many questions remain in this area, relating to potentially irrational behaviour of both humans and artificial agents.
翻译:理性概念是人工智能领域的核心。无论是旨在模拟人类推理,还是追求有限最优性,我们通常都希望使人工智能体尽可能理性。尽管这一概念在AI中具有核心地位,但对于何谓理性智能体尚未形成统一定义。本文综述了人工智能中的理性与非理性问题,并提出了该领域的开放性问题。其他学科对理性的理解影响了其在人工智能中的概念构建,特别是经济学、哲学和心理学领域的研究。聚焦于人工智能体的行为,我们探讨了某些场景下可能被证明是最优的非理性行为。目前已发展出若干处理非理性智能体的方法(包括识别与互动层面),但该领域的研究仍十分有限。那些最初为其他目的(即对抗性场景)开发的方法,或可适用于与人工智能体的交互。我们进一步讨论了人类与人工智能体之间的相互作用,以及理性在此互动中所扮演的角色——该领域仍存在大量与人类和人工智能体潜在非理性行为相关的问题亟待解答。