We examine epistemological threats posed by human and LLM interaction. We develop collective epistemology as a theory of epistemic warrant distributed across human collectives, using bounded rationality and dual process theory as background. We distinguish internalist justification, defined as reflective understanding of why a proposition is true, from externalist justification, defined as reliable transmission of truths. Both are necessary for collective rationality, but only internalist justification produces reflective knowledge. We specify reflective knowledge as follows: agents understand the evaluative basis of a claim, when that basis is unavailable agents consistently assess the reliability of truth sources, and agents have a duty to apply these standards within their domains of competence. We argue that LLMs approximate externalist reliabilism because they can reliably transmit information whose justificatory basis is established elsewhere, but they do not themselves possess reflective justification. Widespread outsourcing of reflective work to reliable LLM outputs can weaken reflective standards of justification, disincentivize comprehension, and reduce agents' capacity to meet professional and civic epistemic duties. To mitigate these risks, we propose a three tier norm program that includes an epistemic interaction model for individual use, institutional and organizational frameworks that seed and enforce norms for epistemically optimal outcomes, and deontic constraints at organizational and or legislative levels that instantiate discursive norms and curb epistemic vices.
翻译:本文探讨人类与大型语言模型(LLM)互动所带来的认识论威胁。我们以有限理性理论和双过程理论为背景,将集体认识论发展为一种在人类集体中分布认知保证的理论。我们区分了内在主义辩护(定义为对命题为何为真的反思性理解)与外在主义辩护(定义为真理的可靠传递)。二者对集体理性皆属必要,但唯有内在主义辩护能产生反思性知识。我们将反思性知识具体界定为:行动者理解主张的评价基础;当该基础不可得时,行动者能持续评估真理来源的可靠性;且行动者有义务在其能力范围内应用这些标准。我们认为,LLM近似于外在主义的可靠论,因为它们能可靠传递已在别处建立辩护基础的信息,但其自身并不具备反思性辩护。若将反思性工作大规模外包给可靠的LLM输出,可能削弱辩护的反思性标准,抑制理解动机,并降低行动者履行专业及公民认知义务的能力。为缓解这些风险,我们提出一个三层规范方案:包含面向个体使用的认知交互模型、为达成最优认知结果而培育并执行规范的制度与组织框架,以及在组织或立法层面确立言说规范并遏制认知恶习的道义约束。