深度学习与医疗专家在腕部骨折X线片检测中的性能比较:系统综述与Meta分析
该系统综述与Meta分析检索2012年1月1日至2023年3月9日多个数据库,纳入6项研究共33,026张腕部X线片,以医疗专家共识为参考标准,评估卷积神经网络检测桡骨与尺骨骨折的诊断准确性。汇总敏感度为92%(95%CI:80%-97%),汇总特异度为93%(95%CI:76%-98%),广义双变量I²统计量提示研究间异质性较大(81.90%)。作者结论认为卷积神经网络的诊断准确性与医疗专家相当。
要点
- 卷积神经网络检测腕部骨折的汇总敏感度为92%(95%CI:80%-97%),汇总特异度为93%(95%CI:76%-98%)。
- 以医疗专家共识为参考标准,卷积神经网络的诊断准确性与医疗专家相当。
- 研究间异质性较大(广义双变量I²=81.90%),4项研究存在至少一个高风险偏倚领域。
核心结论
- 卷积神经网络在腕部X线片上检测腕部骨折的诊断准确性与医疗专家相当。
研究设计与样本
- 系统综述与Meta分析,检索Embase、Medline、PubMed、Scopus和Web of Science(2012年1月1日至2023年3月9日),纳入6项研究共33,026张腕部X线片,目标疾病为桡骨与尺骨骨折,采用基于卷积神经网络的深度学习算法,以医疗专家共识为最低参考标准,使用改良QUADAS-2工具评估,采用双变量随机效应模型进行诊断准确性Meta分析,研究注册于PROSPERO(ID:CRD42023431398)。
诊断标准与关键数值
- 卷积神经网络与参考标准比较的汇总敏感度为92%(95%CI:80%-97%),汇总特异度为93%(95%CI:76%-98%)。
局限性
- 研究间异质性较大,广义双变量I²统计量为81.90%。
- 4项研究存在一个或多个高风险偏倚领域,2项研究存在适用性顾虑。
- 作者指出需要采用稳健参考标准的研究、外部数据集验证以及研究医疗专家借助卷积神经网络后的诊断性能。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVE: To perform a systematic review and meta-analysis of the diagnostic accuracy of deep learning (DL) algorithms in the diagnosis of wrist fractures (WF) on plain wrist radiographs, taking healthcare experts consensus as reference standard.
METHODS: Embase, Medline, PubMed, Scopus and Web of Science were searched in the period from 1 Jan 2012 to 9 March 2023. Eligible studies were patients with wrist radiographs for radial and ulnar fractures as the target condition, studies using DL algorithms based on convolutional neural networks (CNN), and healthcare experts consensus as the minimum reference standard. Studies were assessed with a modified QUADAS-2 tool, and we applied a bivariate random-effects model for meta-analysis of diagnostic test accuracy data.
RESULTS: Our study was registered at PROSPERO with ID: CRD42023431398. We included 6 unique studies for meta-analysis, with a total of 33,026 radiographs. CNN performance compared to reference standards for the included articles found a summary sensitivity of 92% (95% CI: 80%-97%) and a summary specificity of 93% (95% CI: 76%-98%). The generalized bivariate I-squared statistic indicated considerable heterogeneity between the studies (81.90%). Four studies had one or more domains at high risk of bias and two studies had concerns regarding applicability.
CONCLUSION: The diagnostic accuracy of CNNs was comparable to that of healthcare experts in wrist radiographs for investigation of WF. There is a need for studies with a robust reference standard, external data-set validation and investigation of diagnostic performance of healthcare experts aided with CNNs.
CLINICAL RELEVANCE STATEMENT: DL matches healthcare experts in diagnosing WFs, which potentially benefits patient diagnosis.
引用
- Hansen V, Jensen J, Kusk MW, et al. Deep learning performance compared to healthcare experts in detecting wrist fractures from radiographs: A systematic review and meta-analysis. Eur J Radiol. 2024. PMID: 38428318. doi:10.1016/j.ejrad.2024.111399
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。