文献速递乳腺乳腺X线

使用开源BI-RADS数据的人工智能:示例其未来潜在用途

Artificial Intelligence Using Open Source BI-RADS Data Exemplifying Potential Future Use.
PubMed 文献 · J Am Coll Radiol · 2018-10-15

本研究评估放射科医师参与的人工智能工作流程,使用两个开源BI-RADS数据集,训练三种机器学习算法,比较仅用影像参数的模型M1与加入放射科医师BI-RADS分类的模型M2。结果显示,使用放射科医师提供的BI-RADS分类的模型性能显著优于不使用该分类的模型(P < .0001)。作者认为AI与放射科医师协同工作可获得更好结果,有助于基于病例的决策。

要点

  • 采用开源BI-RADS数据集训练机器学习算法,10折交叉验证。
  • M2模型(影像参数+放射科医师BI-RADS分类)AUC和Gini系数显著优于M1(P < .0001)。
  • 作者认为AI与放射科医师协同工作可获得更好结果。

核心结论

  • 使用放射科医师提供的BI-RADS分类的模型性能显著优于不使用该分类的模型(P < .0001)。
  • AI与放射科医师协同工作可获得更好结果,有助于基于病例的决策。
  • 作者认为进一步评估AI算法处理预测变量的指标将提供影像学新见解。

研究设计与样本

  • 研究类型为机器学习算法评估研究,使用两个开源数据集:加州大学欧文分校机器学习库(数据集1)和数字乳腺筛查数据库(数据集2)。
  • 训练三种机器学习算法,采用10折交叉验证。
  • 模型M1仅用影像参数:数据集1使用病灶形状、边缘、密度和患者年龄;数据集2使用图像纹理参数。
  • 模型M2使用上述影像参数加放射科医师提供的BI-RADS分类。
  • 在验证数据集上比较M1与M2的曲线下面积和Gini系数。

诊断标准与关键数值

  • 主要评价指标为曲线下面积和Gini系数,在验证数据集上比较M1与M2。
  • 使用放射科医师BI-RADS分类的模型优于不使用该分类的模型,P < .0001。

临床应用与阅片要点

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVES: With much hype about artificial intelligence (AI) rendering radiologists redundant, a simple radiologist-augmented AI workflow is evaluated; the premise is that inclusion of a radiologist's opinion into an AI algorithm would make the algorithm achieve better accuracy than an algorithm trained on imaging parameters alone. Open-source BI-RADS data sets were evaluated to see whether inclusion of a radiologist's opinion (in the form of BI-RADS classification) in addition to image parameters improved the accuracy of prediction of histology using three machine learning algorithms vis-à-vis algorithms using image parameters alone.

MATERIALS AND METHODS: BI-RADS data sets were obtained from the University of California, Irvine Machine Learning Repository (data set 1) and the Digital Database for Screening Mammography repository (data set 2); three machine learning algorithms were trained using 10-fold cross-validation. Two sets of models were trained: M1, using lesion shape, margin, density, and patient age for data set 1 and image texture parameters for data set 2, and M2, using the previous image parameters and the BI-RADS classification provided by radiologists. The area under the curve and the Gini coefficient for M1 and M2 were compared for the validation data set.

RESULTS: The models using the radiologist-provided BI-RADS classification performed significantly better than the models not using them (P < .0001).

CONCLUSION: AI and radiologist working together can achieve better results, helping in case-based decision making. Further evaluation of the metrics involved in predictor handling by AI algorithms will provide newer insights into imaging.

来源:J Am Coll Radiol,查看原文。版权归原作者所有。

引用

  1. Ghosh A. Artificial Intelligence Using Open Source BI-RADS Data Exemplifying Potential Future Use. J Am Coll Radiol. 2018. PMID: 30337213. doi:10.1016/j.jacr.2018.09.040

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。