The aim of this study is to investigate the effectiveness of ChatGPT 3.5 in developing algorithms for data generation within the framework of Item Response Theory (IRT) using the R programming language. In this context, validity examinations were conducted on data sets generated according to the Two-Parameter Logistic Model (2PLM) with algorithms written by ChatGPT 3.5 and researchers. These examinations considered whether the data sets met the IRT assumptions and the simulation conditions of the item parameters. As a result, it was determined that while ChatGPT 3.5 was quite successful in generating data that met the IRT assumptions, it was less effective in meeting the simulation conditions of the item parameters compared to the algorithm developed by the researchers. In this regard, ChatGPT 3.5 is recommended as a useful tool that researchers can use in developing data generation algorithms for IRT.
翻译:本研究旨在探讨ChatGPT 3.5在运用R编程语言开发项目反应理论(IRT)框架内数据生成算法的有效性。在此背景下,我们对由ChatGPT 3.5和研究人员编写的算法根据双参数逻辑模型(2PLM)生成的数据集进行了效度检验。这些检验考察了数据集是否满足IRT假设以及项目参数的模拟条件。结果表明,虽然ChatGPT 3.5在生成满足IRT假设的数据方面相当成功,但在满足项目参数的模拟条件方面,其效果不如研究人员开发的算法。因此,ChatGPT 3.5被推荐为研究人员在开发IRT数据生成算法时可使用的有用工具。