深度学习辅助缩小不同临床医生类型间的骨折检测准确率差距
本研究评估美国食品药品监督管理局批准的深度学习系统在成人肌肉骨骼X线片上检测骨折时能否提升不同临床医生的诊断准确率。多阅片者多病例研究显示,辅助后所有临床医生的曲线下面积、敏感度和特异度均提高,且影像训练有限的临床医生漏诊率降低至与放射科医生相近水平。
要点
- 深度学习辅助后,临床医生诊断骨折的AUC从0.90升至0.94,敏感度从82%升至90%,特异度从89%升至92%。
- 影像训练有限的临床医生未辅助时漏诊率为20%,辅助后降至9%,与放射科医生的10%相近。
- 2012年至2018年医保索赔数据中,医生助理解读肌肉骨骼X线片的增幅最大。
核心结论
- 临床医生在深度学习系统辅助下诊断骨折更准确,尤其是肌肉骨骼影像解读训练有限的临床医生。
- 减少漏诊骨折可能改善患者诊疗并增加患者活动能力。
研究设计与样本
- 采用公开的医疗保险B部分医师/供应商程序汇总数据分析不同临床医生类型解读肌肉骨骼X线片的趋势。
- 开展多阅片者多病例研究,24名临床医生(放射科医生、骨科医生、医生助理、初级保健医生和急诊医学医生)在辅助和未辅助条件下各评估175例独特的肌肉骨骼X线片病例。
- 骨折诊断金标准为三名美国委员会认证骨科医生或放射科医生独立判读的多数意见。
主要发现
- 辅助时AUC为0.94(95%CI 0.93至0.95),未辅助时AUC为0.90(95%CI 0.89至0.92);按Dorfman、Berbaum、Metz模型最小二乘均值差值AUC为0.04(95%CI 0.01至0.07),p<0.01。
- 辅助时敏感度为90%(95%CI 88%至92%),未辅助时为82%(95%CI 79%至84%)。
- 辅助时特异度为92%(95%CI 91%至93%),未辅助时为89%(95%CI 88%至90%)。
- 影像训练有限的临床医生未辅助时漏诊率为20%(95%CI 17%至24%),放射科医生为14%(95%CI 9%至19%)。
- 辅助后影像训练有限的临床医生漏诊率为9%(95%CI 7%至12%),放射科医生为10%(95%CI 6%至15%)。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Missed fractures are the most common diagnostic errors in musculoskeletal imaging and can result in treatment delays and preventable morbidity. Deep learning, a subfield of artificial intelligence, can be used to accurately detect fractures by training algorithms to emulate the judgments of expert clinicians. Deep learning systems that detect fractures are often limited to specific anatomic regions and require regulatory approval to be used in practice. Once these hurdles are overcome, deep learning systems have the potential to improve clinician diagnostic accuracy and patient care. QUESTIONS/PURPOSES: This study aimed to evaluate whether a Food and Drug Administration-cleared deep learning system that identifies fractures in adult musculoskeletal radiographs would improve diagnostic accuracy for fracture detection across different types of clinicians. Specifically, this study asked: (1) What are the trends in musculoskeletal radiograph interpretation by different clinician types in the publicly available Medicare claims data? (2) Does the deep learning system improve clinician accuracy in diagnosing fractures on radiographs and, if so, is there a greater benefit for clinicians with limited training in musculoskeletal imaging? METHODS: We used the publicly available Medicare Part B Physician/Supplier Procedure Summary data provided by the Centers for Medicare & Medicaid Services to determine the trends in musculoskeletal radiograph interpretation by clinician type. In addition, we conducted a multiple-reader, multiple-case study to assess whether clinician accuracy in diagnosing fractures on radiographs was superior when aided by the deep learning system compared with when unaided. Twenty-four clinicians (radiologists, orthopaedic surgeons, physician assistants, primary care physicians, and emergency medicine physicians) with a median (range) of 16 years (2 to 37) of experience postresidency each assessed 175 unique musculoskeletal radiographic cases under aided and unaided conditions (4200 total case-physician pairs per condition). These cases were comprised of radiographs from 12 different anatomic regions (ankle, clavicle, elbow, femur, forearm, hip, humerus, knee, pelvis, shoulder, tibia and fibula, and wrist) and were randomly selected from 12 hospitals and healthcare centers. The gold standard for fracture diagnosis was the majority opinion of three US board-certified orthopaedic surgeons or radiologists who independently interpreted the case. The clinicians' diagnostic accuracy was determined by the area under the curve (AUC) of the receiver operating characteristic (ROC) curve, sensitivity, and specificity. Secondary analyses evaluated the fracture miss rate (1-sensitivity) by clinicians with and without extensive training in musculoskeletal imaging. RESULTS: Medicare claims data revealed that physician assistants showed the greatest increase in interpretation of musculoskeletal radiographs within the analyzed time period (2012 to 2018), although clinicians with extensive training in imaging (radiologists and orthopaedic surgeons) still interpreted the majority of the musculoskeletal radiographs. Clinicians aided by the deep learning system had higher accuracy diagnosing fractures in radiographs compared with when unaided (unaided AUC: 0.90 [95% CI 0.89 to 0.92]; aided AUC: 0.94 [95% CI 0.93 to 0.95]; difference in least square mean per the Dorfman, Berbaum, Metz model AUC: 0.04 [95% CI 0.01 to 0.07]; p < 0.01). Clinician sensitivity increased when aided compared with when unaided (aided: 90% [95% CI 88% to 92%]; unaided: 82% [95% CI 79% to 84%]), and specificity increased when aided compared with when unaided (aided: 92% [95% CI 91% to 93%]; unaided: 89% [95% CI 88% to 90%]). Clinicians with limited training in musculoskeletal imaging missed a higher percentage of fractures when unaided compared with radiologists (miss rate for clinicians with limited imaging training: 20% [95% CI 17% to 24%]; miss rate for radiologists: 14% [95% CI 9% to 19%]). However, when assisted by the deep learning system, clinicians with limited training in musculoskeletal imaging reduced their fracture miss rate, resulting in a similar miss rate to radiologists (miss rate for clinicians with limited imaging training: 9% [95% CI 7% to 12%]; miss rate for radiologists: 10% [95% CI 6% to 15%]). CONCLUSION: Clinicians were more accurate at diagnosing fractures when aided by the deep learning system, particularly those clinicians with limited training in musculoskeletal image interpretation. Reducing the number of missed fractures may allow for improved patient care and increased patient mobility. LEVEL OF EVIDENCE: Level III, diagnostic study.
引用
- Anderson PG, Baum GL, Keathley N, et al. Deep Learning Assistance Closes the Accuracy Gap in Fracture Detection Across Clinician Types. Clin Orthop Relat Res. 2022. PMID: 36083847. doi:10.1097/CORR.0000000000002385
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。