人工智能在放射学中的当前临床应用及其最佳支持证据
该综述指出放射学人工智能产品缺乏临床验证证据,作者开发了10问题评估工具用于审查商业和开源诊断算法,发现FDA批准算法的方法学技术信息有限且使用数据集远小于开源工具,AI工具在实际临床实践中的性能探索存在巨大空白。
要点
- 放射学AI产品临床验证证据匮乏,产品层面审查缺乏统一标准。
- FDA批准算法的方法学技术信息少于开源产品,可能因知识产权顾虑。
- FDA批准产品使用的数据集远小于开源AI工具。
核心结论
- 研究揭示AI产品成熟度和临床使用范围广泛,但在探索AI工具实际临床实践性能方面存在巨大空白。
研究设计与样本
- 综述类研究,基于临床试验回顾显示放射学AI产品证据匮乏,作者开发了10问题评估工具用于审查AI产品的验证和结果传播,并应用于商业和开源诊断算法以提取临床效用证据。
临床应用与阅片要点
- 作者开发的10问题评估工具强调AI产品的验证和结果传播,可用于审查商业和开源诊断算法。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: Despite tremendous gains from deep learning and the promise of artificial intelligence (AI) in medicine to improve diagnosis and save costs, there exists a large translational gap to implement and use AI products in real-world clinical situations. Adoption of standards such as Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis, Consolidated Standards of Reporting Trials, and the Checklist for Artificial Intelligence in Medical Imaging is increasing to improve the peer-review process and reporting of AI tools. However, no such standards exist for product-level review.
METHODS: A review of clinical trials showed a paucity of evidence for radiology AI products; thus, the authors developed a 10-question assessment tool for reviewing AI products with an emphasis on their validation and result dissemination. The assessment tool was applied to commercial and open-source algorithms used for diagnosis to extract evidence on the clinical utility of the tools.
RESULTS: There is limited technical information on methodologies for FDA-approved algorithms compared with open-source products, likely because of intellectual property concerns. Furthermore, FDA-approved products use much smaller data sets compared with open-source AI tools, because the terms of use of public data sets are limited to academic and noncommercial entities, which precludes their use in commercial products.
CONCLUSIONS: Overall, this study reveals a broad spectrum of maturity and clinical use of AI products, but a large gap exists in exploring actual performance of AI tools in clinical practice.
引用
- Tariq A, Purkayastha S, Padmanaban GP, et al. Current Clinical Applications of Artificial Intelligence in Radiology and Their Best Supporting Evidence. J Am Coll Radiol. 2020. PMID: 33153541. doi:10.1016/j.jacr.2020.08.018
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。