窥探人工智能的黑箱:机器学习方法的评估指标
本文简要概述了机器学习(ML)及其在放射学与医学中的应用,解释了ML中使用的评估指标及如何解读这些指标,并说明了该领域相关的技术术语,以便具有医学背景和基础统计学知识的读者在审视ML应用时更为从容。结论指出,关注样本量、过拟合、欠拟合、交叉验证以及对机器学习指标的广泛了解,可以帮助缺乏技术知识的读者开始评估机器学习研究;然而,方法的透明性和算法的共享对于让临床医生自行评估这些工具至关重要。
要点
- 关注样本量、过拟合、欠拟合与交叉验证,有助于无技术背景的医生初步评估机器学习研究。
- 理解ML评估指标(如敏感度、特异度等)及技术术语,可帮助读者解读ML应用。
- 方法的透明性和算法共享对于临床医生自行评估这些工具至关重要。
核心结论
- 关注样本量、过拟合、欠拟合、交叉验证以及对机器学习指标的广泛了解,可以帮助缺乏技术知识的读者开始评估机器学习研究;然而,方法的透明性和算法的共享对于让临床医生自行评估这些工具至关重要。
研究设计与样本
- 本文为简要概述,旨在解释机器学习(ML)的评估指标、如何解读这些指标以及相关技术术语,面向具有医学背景和基础统计学知识的读者。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVE: Machine learning (ML) and artificial intelligence (AI) are rapidly becoming the most talked about and controversial topics in radiology and medicine. Over the past few years, the numbers of ML- or AI-focused studies in the literature have increased almost exponentially, and ML has become a hot topic at academic and industry conferences. However, despite the increased awareness of ML as a tool, many medical professionals have a poor understanding of how ML works and how to critically appraise studies and tools that are presented to us. Thus, we present a brief overview of ML, explain the metrics used in ML and how to interpret them, and explain some of the technical jargon associated with the field so that readers with a medical background and basic knowledge of statistics can feel more comfortable when examining ML applications.
CONCLUSION: Attention to sample size, overfitting, underfitting, cross validation, as well as a broad knowledge of the metrics of machine learning, can help those with little or no technical knowledge begin to assess machine learning studies. However, transparency in methods and sharing of algorithms is vital to allow clinicians to assess these tools themselves.
引用
- Handelman GS, Kok HK, Chandra RV, et al. Peering Into the Black Box of Artificial Intelligence: Evaluation Metrics of Machine Learning Methods. AJR Am J Roentgenol. 2018. PMID: 30332290. doi:10.2214/AJR.18.20224
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。