Artificial intelligence (AI) developers are rhetorically flirting with the idea that AI systems might have interests or moral rights. While there has been a large volume of research on whether AI deserves rights, there has been less exploration of what AI rights would mean in practice. This paper explores the institutional dimension of AI rights: what it would take to recognize moral or legal rights for AIs, and the attendant opportunities and dangers. Unlike all other nonhuman entities to which humanity has extended rights, AI systems are in principle capable of acquiring and wielding institutional power without human aid and mediation. AIs with rights would be able to legitimately, and AIs with power able to unpreventably, abridge human interests. Accordingly, giving rights even to rather dumb AI systems would entail binding the fate of humanity to potentially unpredictable nonhumans. Accordingly, I defend the rather grandiose claim that to empower AI to claim or to exercise inherent rights would be a world-historical gamble with human self-determination, which no individual researcher, firm, state, or even international organization has the moral right to authorize.

翻译：人工智能（AI）开发者在修辞上倾向于认为AI系统可能拥有利益或道德权利。尽管已有大量研究探讨AI是否应享有权利，但对于AI权利在实践中意味着什么的探索较少。本文探讨了AI权利的制度维度：承认AI的道德或法律权利需要什么条件，以及随之而来的机遇与危险。与人类已赋予权利的所有其他非人类实体不同，AI系统原则上能够无需人类协助和中介获取并行使制度权力。拥有权利的AI将能够合法地、而拥有权力的AI将能够不可阻止地损害人类利益。因此，即使赋予相当笨拙的AI系统权利，也意味着将人类的命运与潜在不可预测的非人类实体绑定。据此，我捍卫一个相当宏大的主张：赋予AI主张或行使固有权利的能力将是一场以人类自我决定为赌注的世界历史性赌博，任何个人研究者、公司、国家甚至国际组织都没有道德权利授权这样做。