Many people are interested in ChatGPT since it has become a prominent AIGC model that provides high-quality responses in various contexts, such as software development and maintenance. Misuse of ChatGPT might cause significant issues, particularly in public safety and education, despite its immense potential. The majority of researchers choose to publish their work on Arxiv. The effectiveness and originality of future work depend on the ability to detect AI components in such contributions. To address this need, this study will analyze a method that can see purposely manufactured content that academic organizations use to post on Arxiv. For this study, a dataset was created using physics, mathematics, and computer science articles. Using the newly built dataset, the following step is to put originality.ai through its paces. The statistical analysis shows that Originality.ai is very accurate, with a rate of 98%.
翻译:人们对ChatGPT的关注与日俱增,因其作为突出的AIGC模型,能在软件开发与维护等多种场景中提供高质量响应。尽管ChatGPT具有巨大潜力,但其滥用可能引发重大问题,尤其在公共安全与教育领域。多数研究者选择将成果发表在Arxiv上。未来工作的有效性与原创性,取决于检测此类投稿中AI成分的能力。为满足这一需求,本研究将分析一种能识别学术机构在Arxiv上发布的人为制造内容的方法。研究过程中,利用物理、数学及计算机科学领域的论文构建了数据集,并基于该新建数据集对原创性检测工具Originality.ai进行性能测试。统计分析表明,Originality.ai的检测准确率高达98%。