The prospect of artificial superintelligence -- AI agents that can generally outperform humans in cognitive tasks and economically valuable activities -- will transform the legal order as we know it. Operating autonomously or under only limited human oversight, AI agents will assume a growing range of roles in the legal system. First, in making consequential decisions and taking real-world actions, AI agents will become de facto subjects of law. Second, to cooperate and compete with other actors (human or non-human), AI agents will harness conventional legal instruments and institutions such as contracts and courts, becoming consumers of law. Third, to the extent AI agents perform the functions of writing, interpreting, and administering law, they will become producers and enforcers of law. These developments, whenever they ultimately occur, will call into question fundamental assumptions in legal theory and doctrine, especially to the extent they ground the legitimacy of legal institutions in their human origins. Attempts to align AI agents with extant human law will also face new challenges as AI agents will not only be a primary target of law, but a core user of law and contributor to law. To contend with the advent of superintelligence, lawmakers -- new and old -- will need to be clear-eyed, recognizing both the opportunity to shape legal institutions as society braces for superintelligence and the reality that, in the longer run, this may be a joint human-AI endeavor.
翻译:超级人工智能的前景——即能够在认知任务和经济价值活动中普遍超越人类的AI主体——将从根本上改变我们已知的法律秩序。在自主运行或仅受有限人类监督的条件下,AI主体将在法律体系中承担日益广泛的角色。首先,在做出关键决策和实施现实行动时,AI主体将成为事实上的法律主体。其次,为与其他行为者(人类或非人类)合作与竞争,AI主体将利用合同、法院等传统法律工具与制度,成为法律的消费者。第三,若AI主体能执行法律起草、解释与管理的职能,它们将成为法律的生产者与执行者。这些发展——无论最终何时实现——都将质疑法律理论与教义中的基本假设,尤其是当法律制度的正当性根植于人类起源时。试图将AI主体与现行人类法律对齐的努力也将面临新挑战,因为AI主体不仅会成为法律的主要规制对象,还将成为法律的核心用户与贡献者。为应对超级智能的到来,新旧立法者需保持清醒认知:既要看到社会为超级智能做准备时塑造法律制度的机遇,也要承认从长远看,这可能是一场人类与AI的协同努力。