前瞻性评估人工智能对胸部或腹部增强CT检查中偶发肺栓塞的分诊效果
这项前瞻性单中心研究在胸部或腹部增强CT检查中比较了放射科医师在无AI辅助(第一阶段)与有AI分诊辅助(第二阶段)下检测偶发肺栓塞的诊断性能与报告周转时间。AI辅助使敏感度从80.0%提高至96.2%(p=.03),特异度无显著差异(99.9% vs 99.9%,p=.58),报告周转时间无显著差异(78.3 vs 74.6分钟,p=.26)。
要点
- AI分诊辅助使放射科医师检测偶发肺栓塞的敏感度从80.0%提高至96.2%(p=.03)。
- AI辅助与无AI辅助的特异度均为99.9%,无显著差异(p=.58)。
- 偶发肺栓塞阳性检查的平均报告周转时间无显著差异(78.3 vs 74.6分钟,p=.26)。
核心结论
- AI分诊系统提高了放射科医师在胸部或腹部增强CT检查中检测偶发肺栓塞的敏感度,报告周转时间无显著变化。
研究设计与样本
- 前瞻性单中心研究,第一阶段纳入1467次检查(1434例患者),第二阶段纳入3182次检查(2886例患者),采用放射科医师小组复核建立偶发肺栓塞参考标准。
诊断标准与关键数值
- 无AI辅助时放射科医师检测偶发肺栓塞的敏感度为80.0%,有AI辅助时为96.2%,差异显著(p=.03)。
- 无AI辅助时特异度为99.9%,有AI辅助时特异度为99.9%,无显著差异(p=.58)。
- 第一阶段偶发肺栓塞频率为1.4%(20/1467),第二阶段为1.6%(52/3182)。
临床应用与阅片要点
- 研究期间放射科安装商用AI分诊算法自动处理CT检查,并通过交互式浮动小部件向放射科医师通知阳性结果。
- 第一阶段小部件未激活,放射科医师无AI辅助判读;第二阶段小部件激活,放射科医师有AI辅助判读。
- 该前瞻性真实世界研究支持使用AI辅助以最大化偶发肺栓塞的检测。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND. Artificial intelligence (AI) algorithms improved detection of incidental pulmonary embolism (IPE) on contrast-enhanced CT (CECT) examinations in retrospective studies; however, prospective validation studies are lacking. OBJECTIVE. The purpose of this study was to assess the effect on radiologists' real-world diagnostic performance and report turnaround times of a radiology department's clinical implementation of an AI triage system for detecting IPE on CECT examinations of the chest or abdomen. METHODS. This prospective single-center study included consecutive adult patients who underwent CECT of the chest or abdomen for reasons other than pulmonary embolism (PE) detection from May 12, 2021, to June 30, 2021 (phase 1), or from September 30, 2021, to December 4, 2021 (phase 2). Before phase 1, the radiology department installed a commercially available AI triage algorithm for IPE detection that automatically processed CT examinations and notified radiologists of positive results through an interactive floating widget. In phase 1, the widget was inactive, and radiologists interpreted examinations without AI assistance. In phase 2, the widget was activated, and radiologists interpreted examinations with AI assistance. A review process involving a panel of radiologists was implemented to establish the reference standard for the presence of IPE. Diagnostic performance and report turnaround times were compared using the Pearson chi-square test and Wilcoxon rank sum test, respectively. RESULTS. Phase 1 included 1467 examinations in 1434 patients (mean age, 53.8 ± 18.5 [SD] years; 753 men, 681 women); phase 2 included 3182 examinations in 2886 patients (mean age, 55.4 ± 18.2 years; 1520 men, 1366 women). The frequency of IPE was 1.4% (20/1467) in phase 1 and 1.6% (52/3182) in phase 2. Radiologists without AI, in comparison to radiologists with AI, showed significantly lower sensitivity (80.0% vs 96.2%, respectively; p = .03), without a significant difference in specificity (99.9% vs 99.9%, p = .58), for the detection of IPE. The mean report turnaround time for IPE-positive examinations was not significantly different between radiologists without AI and radiologists with AI (78.3 vs 74.6 minutes, p = .26). CONCLUSION. An AI triage system improved radiologists' sensitivity for IPE detection on CECT examinations of the chest or abdomen without significant change in report turnaround times. CLINICAL IMPACT. This prospective real-world study supports the use of AI assistance for maximizing IPE detection.
引用
- Savage CH, Elkassem AA, Hamki O, et al. Prospective Evaluation of Artificial Intelligence Triage of Incidental Pulmonary Emboli on Contrast-Enhanced CT Examinations of the Chest or Abdomen. AJR Am J Roentgenol. 2024. PMID: 38899845. doi:10.2214/AJR.24.31067
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。