论编辑流程、人工智能模型与医学文献:磁共振听力测定实验
本实验要求生成式人工智能撰写一篇关于不存在的磁共振听力测定技术的技术报告,获得一份看似技术合理、由方程式和参考文献支撑的完整报告。将该报告投至国际同行评审索引期刊,仅需小修即通过首轮评审。实验表明当前同行评审系统可能尚未准备好应对生成式人工智能技术的爆发。
要点
- 生成式人工智能可无人工干预生成通过同行评审的完整稿件。
- 科学界对人工智能在文献中可能被欺诈性使用存在担忧。
- 当前同行评审系统可能尚未准备好应对生成式人工智能的爆发。
核心结论
- 生成式人工智能模型能够无任何人工干预地创建一份可通过同行评审的完整稿件,鉴于此类技术的爆发,科学界必须对整个人工同行评审过程进行深入讨论。
研究设计与样本
- 实验研究:要求生成式人工智能程序撰写一篇关于不存在的磁共振听力测定技术的技术报告,并将该报告投至国际同行评审索引期刊。
局限性
- 当前同行评审系统已因出版物数量激增而不堪重负,可能尚未准备好应对生成式人工智能技术的爆发。
- 科学界需紧急应对生成式人工智能在科学文献中的问题,并可能需对整个人工同行评审过程进行更深入的讨论。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
The potential of artificial intelligence (AI) in the field of medical research is unquestionable. Nevertheless, the scientific community has raised several concerns about a possible fraudulent use of these tools that might be used to generate inaccurate or, in extreme cases, erroneous messages that could find their way into the literature. In this experiment, we asked a generative AI program to write a technical report on a non-existing Magnetic Resonance Imaging technique called Magnetic Resonance Audiometry, receiving in return a full seemingly technically sound report, substantiated by equations and references. We have submitted this report to an international peer-reviewed indexed journal, passing the first round of review with only minor changes requested. With this experiment, we showed that the current peer-review system, already burdened by the overwhelming increase in number of publications, might be not ready to also handle the explosion of these techniques, showing the urgent need for the entire community to address both the issue of generative AI in scientific literature and probably a more profound discussion on the entire peer-review process. CLINICAL RELEVANCE STATEMENT: Generative AI models are shown to be able to create a full manuscript without any human intervention that can survive peer-review. Given the explosion of these techniques, a profound discussion on the entire peer-review process by the scientific community is mandatory. KEY POINTS: • The scientific community has raised several concerns about a possible fraudulent use of AI in scientific literature. • We asked a generative AI program to write a technical report on a non-existing technique, receiving in return a full technically sound report, substantiated by equations and references, that passed peer-review. • This experiment showed that the current peer-review system might be not ready to handle the explosion of generative AI techniques, advising for a profound discussion on the entire peer-review process.
引用
- Cocozza S, Palma G. Of editorial processes, AI models, and medical literature: the Magnetic Resonance Audiometry experiment. Eur Radiol. 2024. PMID: 38451324. doi:10.1007/s00330-024-10668-w
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。