The public release of ChatGPT has resulted in considerable publicity and has led to wide-spread discussion of the usefulness and capabilities of generative AI language models. Its ability to extract and summarise data from textual sources and present them as human-like contextual responses makes it an eminently suitable tool to answer questions users might ask. This paper tested what archaeological literature appears to have been included in ChatGPT's training phase. While ChatGPT offered seemingly pertinent references, a large percentage proved to be fictitious. Using cloze analysis to make inferences on the sources 'memorised' by a generative AI model, this paper was unable to prove that ChatGPT had access to the full texts of the genuine references. It can be shown that all references provided by ChatGPT that were found to be genuine have also been cited on Wikipedia pages. This strongly indicates that the source base for at least some of the data is found in those pages. The implications of this in relation to data quality are discussed.

翻译：ChatGPT的公开上线引发了广泛关注，并促使学界对生成式AI语言模型的实用性与能力展开深入讨论。该模型能够从文本资料中提取并总结数据，并以类人化的情境响应呈现，使其成为解答用户问题的理想工具。本文测试了哪些考古学文献可能被纳入ChatGPT的训练阶段。尽管ChatGPT提供了看似相关的参考文献，但其中相当大比例被证实为虚构。通过使用完形分析推断生成式AI模型"记忆"的来源，本研究无法证明ChatGPT能够获取真实参考文献的全文。研究表明，所有经查证为真实的ChatGPT所引用的参考文献，均曾出现在维基百科页面中。这强烈表明，至少部分数据源来自这些维基百科页面。本文进一步讨论了这一发现对数据质量的影响。