Recent advancements in artificial intelligence have reopened the question about the boundaries of AI autonomy, particularly in discussions around artificial general intelligence and its potential to act independently across varied purposes. This paper explores these boundaries through the analysis of the Alignment Research Center experiment on GPT-4 and introduces the Start Button Problem, a thought experiment that examines the origins and limits of AI autonomy. By examining the thought experiment and its counterarguments, it becomes clear that in its need for human activation and purpose definition lies the AI's inherent dependency on human-initiated actions, challenging the assumption of AI as an intelligent agent. Finally, the paper addresses the implications of this dependency on human responsibility, questioning the measure of the extension of human responsibility when using AI systems.

翻译：人工智能的最新进展重新引发了关于AI自主性边界的讨论，尤其是在人工通用智能及其在不同目的下独立行动潜力的探讨中。本文通过分析对齐研究中心对GPT-4的实验，探讨这些边界，并引入"启动按钮问题"这一思想实验，以审视AI自主性的起源与局限。通过分析该思想实验及其反驳观点可以明确，AI对人类激活与目的定义的需求揭示了其本质上对人类发起行动的依赖性，这对将AI视为智能代理的假设提出了挑战。最后，本文探讨了这种依赖性对人类责任的影响，质疑使用AI系统时人类责任延伸程度的衡量标准。