评估放射学中人工智能驱动诊断工具的性能与临床效用
本文提供了一套结构化入门指南,用于在人工智能模型的开发与部署全生命周期中对其进行评估。文章概述了内部测试与外部测试的关键原则,强调了针对人工智能输出(包括分类、检测、分割和连续测量)量身定制的性能指标,并描述了如何通过多阅片者多病例研究来评估临床影响。文章还纳入了放射学研究中的实践示例以及更新的报告标准。
要点
- 评估人工智能工具需贯穿开发与部署全生命周期,内部测试与外部测试均至关重要。
- 性能指标应针对人工智能输出类型(分类、检测、分割、连续测量)选择。
- 多阅片者多病例研究可用于评估人工智能工具对临床的影响。
核心结论
- 文章旨在通过将核心统计学概念转化为放射学专用指南,支持放射科医生、研究人员和审稿人开展和解读高质量的人工智能评估研究。
研究设计与样本
- 本文为结构化入门指南,涵盖人工智能模型开发与部署全生命周期的评估,包括内部测试与外部测试原则、针对人工智能输出的性能指标以及多阅片者多病例研究设计。
临床应用与阅片要点
- 作者旨在支持放射科医生、研究人员和审稿人开展和解读高质量的人工智能评估研究。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
The increasing integration of artificial intelligence (AI) tools into radiology has created an urgent need for clear, practical guidance on how to evaluate them. These tools, including computer-assisted detection and triage devices, hold promise for improving accuracy, efficiency, and workflow. However, their adoption into clinical practice requires rigorous evaluation to ensure safety, generalizability, and clinical value. Radiology has a strong foundation in diagnostic test assessment, and AI models represent an extension of this tradition, with new considerations in evaluation strategy, performance measurement, and study design. This article provides a structured primer on evaluating AI models across their development and deployment life cycle. It outlines key principles for internal and external testing, highlights performance metrics tailored to AI outputs-including classification, detection, segmentation, and continuous measures-and describes how to assess clinical impact with multireader multicase studies. Practical examples from radiology research, as well as updated reporting standards, are incorporated throughout. By translating core statistical concepts into radiology-specific guidance, this article aims to support radiologists, researchers, and reviewers in conducting and interpreting high-quality AI evaluation studies.
引用
- Mercaldo SF, Hillis JM, Blume JD, et al. Evaluating the Performance and Clinical Utility of AI-driven Diagnostic Tools in Radiology. Radiology. 2025. PMID: 41288482. doi:10.1148/radiol.243935
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。