Generative artificial intelligence (AI) tools are becoming increasingly used for writing tasks. However, the extent of their use in peer-reviewed medical literature remains unclear. We conducted a longitudinal analysis of all Original Investigations, Research Letters, and Invited Commentaries published in JAMA Network Open from January 2022 through March 2025. The main body text of 7,251 articles was analyzed using a commercial AI-detection tool (Originality.AI) to estimate the probability that manuscripts contained a significant amount of AI-generated content. Articles were analyzed aggregated by month, publication type, and domain. Overall, 195 articles (2.7%) were classified as containing significant AI-generated text. The monthly proportion increased from 0.0% in January 2022 to 11.3% in March 2025, with a significant upward trend over time (P<0.001). Invited Commentaries had the highest proportion of detected AI-generated content (6.7%), followed by Original Investigations (2.2%) and Research Letters (1.4%). There was also significant variation across publication domain (P=0.04). Only 15 articles (0.2%) disclosed large language model use, of which 40.0% were classified as containing AI-generated text. While findings suggest increasing detectable AI-generated content in medical literature, limitations of current detection tools necessitates cautious interpretation.
翻译:生成式人工智能(AI)工具在写作任务中的应用日益广泛,但其在同行评议医学文献中的使用程度仍不明确。我们对《JAMA Network Open》2022年1月至2025年3月期间发表的所有原创研究、研究快报和特邀评论进行了纵向分析。使用商业AI检测工具(Originality.AI)对7,251篇文章的正文进行分析,以估算手稿包含大量AI生成内容的概率。文章按月份、发表类型和领域进行汇总分析。总体而言,195篇文章(2.7%)被归类为包含大量AI生成文本。月度比例从2022年1月的0.0%上升至2025年3月的11.3%,呈显著上升趋势(P<0.001)。特邀评论中检测到的AI生成内容比例最高(6.7%),其次是原创研究(2.2%)和研究快报(1.4%)。不同发表领域间也存在显著差异(P=0.04)。仅有15篇文章(0.2%)披露使用了大型语言模型,其中40.0%被归类为包含AI生成文本。虽然研究结果表明医学文献中可检测到的AI生成内容不断增加,但当前检测工具的局限性要求我们谨慎解读这些结果。