公众号 / 文章技术与安全

放射科医生评估人工智能临床研究论文指南:我们的做法

Radiologist's Guide to Evaluating Publications of Clinical Research on AI: How We Do It.
PubMed 文献 · Radiology · 2023-01-01

本文为放射科医生提供一份评估人工智能(AI)临床研究论文的简明指南,列出10个关键检查条目:研究目的、AI功能与临床背景、训练数据、数据预处理、AI建模技术、测试数据、AI性能、AI的帮助与价值、AI可解释性及代码共享。逐项评估有助于放射科医生判断AI临床研究论文的有效性、可重复性和临床适用性。

要点

  • 评估AI研究需关注训练数据与测试数据的来源、划分及是否存在数据泄漏。
  • AI性能指标应结合临床背景解读,注意其帮助与价值及可解释性。
  • 代码共享情况可影响研究的可重复性评估。

核心结论

  • 逐项检查10个关键条目可帮助放射科医生评估AI临床研究论文的有效性、可重复性和临床适用性。

研究设计与样本

  • 本特殊报告为面向临床放射科医生的简明指南,非全面检查清单或方法学总结,亦非报告指南;围绕10个关键条目展开说明。

临床应用与阅片要点

  • 阅读AI临床研究论文时,可依次核对研究目的、AI功能与临床背景、训练数据、数据预处理、AI建模技术、测试数据、AI性能、AI帮助与价值、AI可解释性及代码共享10个条目。

局限性

  • 原文明确本报告不打算作为AI完整临床评估的全面检查清单或方法学总结,亦非报告指南。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Literacy in research studies of artificial intelligence (AI) has become an important skill for radiologists. It is required to make a proper assessment of the validity, reproducibility, and clinical applicability of AI studies. However, AI studies are generally perceived to be more difficult for clinician readers to evaluate than traditional clinical research studies. This special report-as an effective, concise guide for readers-aims to assist clinical radiologists in critically evaluating different types of clinical research articles involving AI. It does not intend to be a comprehensive checklist or methodological summary for complete clinical evaluation of AI or a reporting guideline. Ten key items for readers to check are described, regarding study purpose, function and clinical context of AI, training data, data preprocessing, AI modeling techniques, test data, AI performance, helpfulness and value of AI, interpretability of AI, and code sharing. The important aspects of each item are explained for readers to consider when reading publications on AI clinical research. Evaluating each item can help radiologists assess the validity, reproducibility, and clinical applicability of clinical research articles involving AI.

来源:Radiology,查看原文。版权归原作者所有。

引用

  1. Park SH, Sul AR, Ko Y, et al. Radiologist's Guide to Evaluating Publications of Clinical Research on AI: How We Do It. Radiology. 2023. PMID: 37750772. doi:10.1148/radiol.230288

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。