人工智能诊断骨科骨折的诊断准确性及潜在协变量:系统文献综述与Meta分析
该系统综述与Meta分析检索四个数据库至2021年9月29日,纳入39项研究,汇总AI诊断骨科骨折的AUC为0.96、敏感度90%、特异度92%;多中心设计、迁移学习和数据增强与更高性能相关,AI与人类专家AUC相当但优于非专家读者。
要点
- AI诊断骨科骨折汇总AUC 0.96、敏感度90%、特异度92%。
- 多中心设计、迁移学习、数据增强与AI模型性能提升相关。
- AI与人类专家AUC相当,但优于非专家读者。
核心结论
- AI在医学图像诊断骨科骨折方面表现出高准确性。
- 需要更大规模、更高质量的研究来验证这些发现。
研究设计与样本
- 系统文献综述与Meta分析,系统检索PubMed、Embase、Web of Science和Cochrane Library自建库至2021年9月29日的文献。
- 39项研究纳入定量分析。
- 研究已在PROSPERO注册(CRD 42021254618)。
诊断标准与关键数值
- 总体汇总AUC为0.96(95% CI 0.94-0.98),敏感度90%(95% CI 87-92%),特异度92%(95% CI 90-94%)。
- 多中心设计研究敏感度92% vs 单中心88%,特异度94% vs 单中心91%。
- 使用迁移学习敏感度92% vs 未使用87%;使用数据增强敏感度92% vs 未使用87%。
- 以平片X线作为输入图像AI的AUC 0.96 vs CT 0.96。
- AI与人类读者AUC 0.97 vs 0.97;AI vs 非专家人类读者AUC 0.98 vs 0.96,敏感度95% vs 88%。
局限性
- 需要更大规模、更高质量的研究来验证这些发现。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVES: To systematically quantify the diagnostic accuracy and identify potential covariates affecting the performance of artificial intelligence (AI) in diagnosing orthopedic fractures.
METHODS: PubMed, Embase, Web of Science, and Cochrane Library were systematically searched for studies on AI applications in diagnosing orthopedic fractures from inception to September 29, 2021. Pooled sensitivity and specificity and the area under the receiver operating characteristic curves (AUC) were obtained. This study was registered in the PROSPERO database prior to initiation (CRD 42021254618).
RESULTS: Thirty-nine were eligible for quantitative analysis. The overall pooled AUC, sensitivity, and specificity were 0.96 (95% CI 0.94-0.98), 90% (95% CI 87-92%), and 92% (95% CI 90-94%), respectively. In subgroup analyses, multicenter designed studies yielded higher sensitivity (92% vs. 88%) and specificity (94% vs. 91%) than single-center studies. AI demonstrated higher sensitivity with transfer learning (with vs. without: 92% vs. 87%) or data augmentation (with vs. without: 92% vs. 87%), compared to those without. Utilizing plain X-rays as input images for AI achieved results comparable to CT (AUC 0.96 vs. 0.96). Moreover, AI achieved comparable results to humans (AUC 0.97 vs. 0.97) and better results than non-expert human readers (AUC 0.98 vs. 0.96; sensitivity 95% vs. 88%).
CONCLUSIONS: AI demonstrated high accuracy in diagnosing orthopedic fractures from medical images. Larger-scale studies with higher design quality are needed to validate our findings.
KEY POINTS: • Multicenter study design, application of transfer learning, and data augmentation are closely related to improving the performance of artificial intelligence models in diagnosing orthopedic fractures. • Utilizing plain X-rays as input images for AI to diagnose fractures achieved results comparable to CT (AUC 0.96 vs. 0.96). • AI achieved comparable results to humans (AUC 0.97 vs. 0.97) but was superior to non-expert human readers (AUC 0.98 vs. 0.96, sensitivity 95% vs. 88%) in diagnosing fractures.
引用
- Zhang, Yang, Shen, et al. Diagnostic accuracy and potential covariates of artificial intelligence for diagnosing orthopedic fractures: a systematic literature review and meta-analysis. Eur Radiol. 2022. PMID: 35754091. doi:10.1007/s00330-022-08956-4
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。