文献速递骨肌MR

自然语言处理算法自动关联膝关节半月板撕裂的影像与关节镜报告

Automated Radiology-Arthroscopy Correlation of Knee Meniscal Tears Using Natural Language Processing Algorithms.
PubMed 文献 · Acad Radiol · 2021-02-11

本研究为回顾性单机构研究,使用3593份人工标注的膝关节MRI报告训练监督机器学习模型检测内、外侧半月板撕裂,并在108份1年内行关节镜的测试集MRI及关节镜报告上评估影像-关节镜一致性。自然语言处理模型在MRI报告上交叉验证F1分数内侧0.93-0.94、外侧0.86-0.88,在关节镜报告上集成模型F1分数内侧0.97、外侧0.99;集成模型检测MRI与关节镜报告间不匹配的敏感度79%、特异度87%。作者认为该自动化关联可用于教学和质量改进。

要点

  • 自然语言处理模型可从自由文本膝关节MRI报告检测半月板撕裂,内侧F1 0.93-0.94、外侧0.86-0.88。
  • 模型从未训练于关节镜报告,但在关节镜报告上表现相似,集成后内侧F1 0.97、外侧0.99。
  • 集成模型检测MRI与关节镜报告不匹配的敏感度79%、特异度87%。

诊断标准与关键数值

  • MRI报告半月板撕裂检测交叉验证F1分数:内侧半月板0.93-0.94,外侧半月板0.86-0.88。
  • 关节镜报告上集成模型F1分数:内侧半月板0.97,外侧半月板0.99。
  • 影像-关节镜测试集中,集成自然语言处理模型检测MRI与关节镜报告间不匹配的敏感度79%、特异度87%。

临床应用与阅片要点

  • 作者认为影像-关节镜关联的自动化对教学和质量改进有前景。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

RATIONALE AND OBJECTIVES: Train and apply natural language processing (NLP) algorithms for automated radiology-arthroscopy correlation of meniscal tears.

MATERIALS AND METHODS: In this retrospective single-institution study, we trained supervised machine learning models (logistic regression, support vector machine, and random forest) to detect medial or lateral meniscus tears on free-text MRI reports. We trained and evaluated model performances with cross-validation using 3593 manually annotated knee MRI reports. To assess radiology-arthroscopy correlation, we then randomly partitioned this dataset 80:20 for training and testing, where 108 test set MRIs were followed by knee arthroscopy within 1 year. These free-text arthroscopy reports were also manually annotated. The NLP algorithms trained on the knee MRI training dataset were then evaluated on the MRI and arthroscopy report test datasets. We assessed radiology-arthroscopy agreement using the ensembled NLP-extracted findings versus manually annotated findings.

RESULTS: The NLP models showed high cross-validation performance for meniscal tear detection on knee MRI reports (medial meniscus F1 scores 0.93-0.94, lateral meniscus F1 scores 0.86-0.88). When these algorithms were evaluated on arthroscopy reports, despite never training on arthroscopy reports, performance was similar, though higher with model ensembling (medial meniscus F1 score 0.97, lateral meniscus F1 score 0.99). However, ensembling did not improve performance on knee MRI reports. In the radiology-arthroscopy test set, the ensembled NLP models were able to detect mismatches between MRI and arthroscopy reports with sensitivity 79% and specificity 87%.

CONCLUSION: Radiology-arthroscopy correlation can be automated for knee meniscal tears using NLP algorithms, which shows promise for education and quality improvement.

来源:Acad Radiol,查看原文。版权归原作者所有。

引用

  1. Li MD, Deng F, Chang K, et al. Automated Radiology-Arthroscopy Correlation of Knee Meniscal Tears Using Natural Language Processing Algorithms. Acad Radiol. 2021. PMID: 33583713. doi:10.1016/j.acra.2021.01.017

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。