文献速递骨肌神经技术与安全MR

基于NLP的放射报告差异自动检测与分类:住院医师教育与质量保证工具

Automated Detection and Classification of Radiology Report Discrepancies Using NLP: A Tool for Resident Education and Quality Assurance.
PubMed 文献 · J Am Coll Radiol · 2026-04-01

本研究回顾性分析889份腰椎MRI报告,开发多步NLP流程自动检测并分类初步与最终报告间的差异,共11种纠正类型。系统对各类纠正类型的准确率0.983-0.999、敏感度0.977-1.000、特异度0.900-1.000,组内相关系数>0.75。最常见纠正为误诊(504/768,65.6%)和漏诊(356/768,46.4%),住院医师与主治医师的纠正模式均存在显著异质性。

要点

  • NLP系统可高精度自动识别报告差异并分类为11种纠正类型。
  • 误诊和漏诊是最常见的报告纠正类型。
  • 住院医师与主治医师的纠正模式均存在显著个体差异。

局限性

  • 单中心回顾性研究,仅针对腰椎MRI报告。
  • 样本量及设备/序列信息未在原文中详细报告。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

PURPOSE: The aim of this study was to develop and evaluate a natural language processing (NLP) system that automatically detects and classifies discrepancies between preliminary and final radiology reports, with the goal of enhancing resident education through structured feedback.

METHODS: A total of 889 deidentified lumbar spine MRI reports (768 with revisions) from December 2023 to March 2024 were retrospectively analyzed. Preliminary full diagnostic reports were generated by trainee residents during daytime rotations; final reports were subsequently verified by attending radiologists remotely. Discrepancies in the diagnostic impression section were extracted using a multistep NLP pipeline: sentence segmentation, Bidirectional Encoder Representations From Transformers-based sentence matching, GPT-4-based named entity recognition, and rule-based classification into 11 correction types (missed diagnosis, misdiagnosis, missed image feature, misidentified image feature, localization error, diagnostic reasoning error, clinical query omission, severity error, confidence difference, typographic error, and terminology refinement). Ground truth was established by three radiologists. System performance was evaluated for each correction type individually using accuracy, sensitivity, specificity, and intraclass coefficient. Trends in resident and attending radiologist performance were analyzed at the report level.

RESULTS: The NLP system achieved high accuracy (0.983-0.999), sensitivity (0.977-1.000), and specificity (0.900-1.000) for each of the 11 correction types, with strong interrater reliability (intraclass correlation coefficient > 0.75). Most common corrections were misdiagnosis (504 of 768 [65.6%]) and missed diagnosis (356 of 768 [46.4%]). Residents showed significant variability in error rates, especially in missed diagnosis (range, 11.1%-59.1% across 16 residents) and misdiagnosis (range, 24.0%-71.1% across 16 residents). Attending radiologists exhibited marked heterogeneity in correction patterns (n = 6; individual workload range, 95-187 reports; median, 159 reports), with significant variability across all major error types (P < .001 for missed diagnosis [20.6%-82.0%], misdiagnosis [31.4%-66.7%], localization error [15.8%-54.7%], and terminology refinement [3.2%-36.7%]).

CONCLUSIONS: The NLP-based discrepancy tracking system accurately identifies and classifies report modifications, enabling scalable, targeted feedback for radiology residents. Variability among residents and attending radiologists highlights the need for individualized training and standardized review practices.

来源:J Am Coll Radiol,查看原文。版权归原作者所有。

引用

  1. Wang K, Wang H, Wu J, et al. Automated Detection and Classification of Radiology Report Discrepancies Using NLP: A Tool for Resident Education and Quality Assurance. J Am Coll Radiol. 2026. PMID: 41933671. doi:10.1016/j.jacr.2026.03.015

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。