放射学人工智能临床评估中结局指标与测量方法的概念性综述
本综述针对临床放射科医生,概念性直观解释人工智能临床评估中最常用的结局指标与测量方法;简要讨论二分类、检测或分割任务的性能指标,重点阐述多分类分类评估指标、生成式AI模型(图像生成或修改及大语言模型)的评估指标,以及性能指标之外以患者为中心的结局测量,旨在指导临床医生恰当使用这些指标与测量方法。
要点
- 临床评估AI时结局指标多样,放射科医生需理解其概念以恰当解读研究。
- 二分类、检测、分割任务的性能指标仅作简要讨论,非本综述重点。
- 重点涵盖多分类分类、生成式AI及患者为中心结局的测量方法。
核心结论
- 本综述旨在为临床医生提供概念性直观解释,指导其恰当使用放射学人工智能临床评估中的结局指标与测量方法。
研究设计与样本
- 概念性综述,未报告检索范围与纳入文献;面向临床医生,解释AI临床研究中常用的结局指标与测量方法。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Artificial intelligence (AI) has numerous applications in radiology. Clinical research studies to evaluate the AI models are also diverse. Consequently, diverse outcome metrics and measures are employed in the clinical evaluation of AI, presenting a challenge for clinical radiologists. This review aims to provide conceptually intuitive explanations of the outcome metrics and measures that are most frequently used in clinical research, specifically tailored for clinicians. While we briefly discuss performance metrics for AI models in binary classification, detection, or segmentation tasks, our primary focus is on less frequently addressed topics in published literature. These include metrics and measures for evaluating multiclass classification; those for evaluating generative AI models, such as models used in image generation or modification and large language models; and outcome measures beyond performance metrics, including patient-centered outcome measures. Our explanations aim to guide clinicians in the appropriate use of these metrics and measures.
引用
- Park SH, Han K, Lee JG, et al. Conceptual review of outcome metrics and measures used in clinical evaluation of artificial intelligence in radiology. Radiol Med. 2024. PMID: 39225919. doi:10.1007/s11547-024-01886-9
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。