AI risks are typically framed around physical threats to humanity, a loss of control or an accidental error causing humanity's extinction. However, I argue in line with the gradual disempowerment thesis, that there is an underappreciated risk in the slow and irrevocable decline of human autonomy. As AI starts to outcompete humans in various areas of life, a tipping point will be reached where it no longer makes sense to rely on human decision-making, creativity, social care or even leadership. What may follow is a process of gradual de-skilling, where we lose skills that we currently take for granted. Traditionally, it is argued that AI will gain human skills over time, and that these skills are innate and immutable in humans. By contrast, I argue that humans may lose such skills as critical thinking, decision-making and even social care in an AGI world. The biggest threat to humanity is therefore not that machines will become more like humans, but that humans will become more like machines.

翻译：人工智能风险通常被框定为对人类构成的物理威胁、失控或意外错误导致人类灭绝。然而，我依据逐渐失权论题提出，人类自主性缓慢且不可逆转的衰退这一风险尚未得到充分重视。随着人工智能在生活各领域开始超越人类，我们将达到一个临界点，届时依赖人类决策、创造力、社会关怀甚至领导力将不再具有意义。随之而来的可能是一个逐渐去技能化的过程，我们将丧失当前视为理所当然的技能。传统观点认为，人工智能将随时间推移获得人类技能，而这些技能在人类中是固有且不可改变的。相反，我认为在通用人工智能世界中，人类可能会丧失批判性思维、决策甚至社会关怀等技能。因此，人类面临的最大威胁并非机器将变得更像人类，而是人类将变得更像机器。