人工智能算法与放射科医师在颈椎CT骨折检测中的诊断准确性比较
单中心回顾性诊断准确性研究纳入2007—2014年连续2368例颈椎CT筛查患者,以放射科医师与神经外科医师复核为参考标准,比较深度学习AI与主治放射科医师的诊断准确性。AI敏感度71.5%、特异度98.6%,主治放射科医师敏感度88.2%、特异度99.2%;AI漏诊的骨折中需稳定治疗者比例更高,但AI检出了放射科医师漏诊的84.6%骨折,包括需稳定治疗的骨折。
要点
- AI敏感度71.5%低于主治放射科医师88.2%,特异度98.6%与99.2%无显著差异。
- AI漏诊骨折中30/63为需稳定治疗骨折,放射科医师漏诊中4/26为需稳定治疗骨折。
- AI检出放射科医师漏诊的22/26骨折,包括3/4需稳定治疗骨折。
核心结论
- 与主治放射科医师相比,AI检测颈椎CT骨折的敏感度更低、需稳定治疗骨折的漏诊率更高,但AI检出了放射科医师漏诊的大部分骨折,包括需稳定治疗的骨折。
研究设计与样本
- 单中心回顾性诊断准确性研究,纳入2007—2014年连续年龄≥18岁、因颈椎骨折筛查行CT的患者,共分析2368例扫描;由1名放射科医师和3名神经外科医师独立复核阳性扫描确定参考标准,阴性扫描随访至2022年并通过病历复核,AI标记为阳性而原判阴性的扫描由2名放射科医师复核;神经外科医师判定需稳定治疗的骨折。
诊断标准与关键数值
- AI检出158/221例骨折扫描(敏感度71.5%,95%CI 65.5-77.4%),特异度98.6%(95%CI 98.2-99.1%,2118/2147例无骨折扫描);主治放射科医师检出195/221例(敏感度88.2%,95%CI 84.0-92.5%,p<0.001),特异度99.2%(95%CI 98.8-99.6,p=0.07)。
临床应用与阅片要点
- AI算法在颈椎CT骨折检测中表现为可与放射科医师并发阅读的潜力;AI漏诊骨折中需稳定治疗者比例高于放射科医师漏诊者,阅片时需关注AI阴性但临床高度怀疑骨折的情况。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVES: To compare diagnostic accuracy of a deep learning artificial intelligence (AI) for cervical spine (C-spine) fracture detection on CT to attending radiologists and assess which undetected fractures were injuries in need of stabilising therapy (IST).
METHODS: This single-centre, retrospective diagnostic accuracy study included consecutive patients (age ≥18 years; 2007-2014) screened for C-spine fractures with CT. To validate ground truth, one radiologist and three neurosurgeons independently examined scans positive for fracture. Negative scans were followed up until 2022 through patient files and two radiologists reviewed negative scans that were flagged positive by AI. The neurosurgeons determined which fractures were ISTs. Diagnostic accuracy of AI and attending radiologists (index tests) were compared using McNemar.
RESULTS: Of the 2368 scans (median age, 48, interquartile range 30-65; 1441 men) analysed, 221 (9.3%) scans contained C-spine fractures with 133 IST. AI detected 158/221 scans with fractures (sensitivity 71.5%, 95% CI 65.5-77.4%) and 2118/2147 scans without fractures (specificity 98.6%, 95% CI 98.2-99.1). In comparison, attending radiologists detected 195/221 scans with fractures (sensitivity 88.2%, 95% CI 84.0-92.5%, p < 0.001) and 2130/2147 scans without fracture (specificity 99.2%, 95% CI 98.8-99.6, p = 0.07). Of the fractures undetected by AI 30/63 were ISTs versus 4/26 for radiologists. AI detected 22/26 fractures undetected by the radiologists, including 3/4 undetected ISTs.
CONCLUSION: Compared to attending radiologists, the artificial intelligence has a lower sensitivity and a higher miss rate of fractures in need of stabilising therapy; however, it detected most fractures undetected by the radiologists, including fractures in need of stabilising therapy. Clinical relevance statement The artificial intelligence algorithm missed more cervical spine fractures on CT than attending radiologists, but detected 84.6% of fractures undetected by radiologists, including fractures in need of stabilising therapy.
KEY POINTS: The impact of artificial intelligence for cervical spine fracture detection on CT on fracture management is unknown. The algorithm detected less fractures than attending radiologists, but detected most fractures undetected by the radiologists including almost all in need of stabilising therapy. The artificial intelligence algorithm shows potential as a concurrent reader.
引用
- van den Wittenboer GJ, van der Kolk BYM, Nijholt IM, et al. Diagnostic accuracy of an artificial intelligence algorithm versus radiologists for fracture detection on cervical spine CT. Eur Radiol. 2024. PMID: 38206401. doi:10.1007/s00330-023-10559-6
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。