In the era of generative AI and specifically large language models (LLMs), exemplified by ChatGPT, the intersection of artificial intelligence and human reasoning has become a focal point of global attention. Unlike conventional search engines, LLMs go beyond mere information retrieval, entering into the realm of discourse culture. Its outputs mimic well-considered, independent opinions or statements of facts, presenting a pretense of wisdom. This paper explores the potential transformative impact of LLMs on democratic societies. It delves into the concerns regarding the difficulty in distinguishing ChatGPT-generated texts from human output. The discussion emphasizes the essence of authorship, rooted in the unique human capacity for reason - a quality indispensable for democratic discourse and successful collaboration within free societies. Highlighting the potential threats to democracy, this paper presents three arguments: the Substitution argument, the Authenticity argument, and the Facts argument. These arguments highlight the potential risks that are associated with an overreliance on LLMs. The central thesis posits that widespread deployment of LLMs may adversely affect the fabric of a democracy if not comprehended and addressed proactively and properly. In proposing a solution, we advocate for an emphasis on education as a means to mitigate risks. We suggest cultivating thinking skills in children, fostering coherent thought formulation, and distinguishing between machine-generated output and genuine, i.e. human, reasoning. The focus should be on responsible development and usage of LLMs, with the goal of augmenting human capacities in thinking, deliberating and decision-making rather than substituting them.

翻译：在生成式AI，特别是以ChatGPT为代表的大型语言模型（LLMs）时代，人工智能与人类推理的交汇点已成为全球关注的焦点。与传统搜索引擎不同，LLMs超越了单纯的信息检索，进入了话语文化领域。其输出模仿深思熟虑的独立见解或事实陈述，呈现出一种智慧的假象。本文探讨了LLMs对民主社会的潜在变革性影响，深入分析了区分ChatGPT生成文本与人类输出所面临的困难。讨论强调了作者身份的本质，这一本质根植于人类独特的推理能力——这种能力对于民主话语和自由社会中的成功合作不可或缺。为凸显对民主的潜在威胁，本文提出了三个论点：替代论、真实性论和事实论。这些论点指出了过度依赖LLMs相关的潜在风险。核心论点是，若未能主动且恰当地理解并应对，LLMs的广泛部署可能对民主架构产生不利影响。在提出解决方案时，我们主张强调教育作为风险缓解的途径。建议培养儿童的思维能力，促进连贯思想的形成，并区分机器生成输出与真正的人类推理。重点应放在负责任地开发和使用LLMs上，目标在于增强而非取代人类在思考、审议和决策中的能力。