文献速递胸部技术与安全DR

气胸检测人工智能算法在真实世界中的表现及其对放射科医生报告时间的影响

Real-World Performance of Pneumothorax-Detecting Artificial Intelligence Algorithm and its Impact on Radiologist Reporting Times.
PubMed 文献 · Acad Radiol · 2024-10-29

本研究回顾性纳入2020年8月至2021年4月连续采集的27,397张成人住院患者胸部正位单视图X线片,评估FDA批准的气胸检测AI工具的诊断准确度及对报告周转时间的影响。AI工具总体AUC为0.78,敏感度0.60、特异度0.97;针对中/大型气胸AUC升至0.93、敏感度0.89、特异度0.96。AI整合系统使放射科医生确认气胸的报告中位时间从186分钟降至100分钟,降低46%(p<.001)。

要点

  • AI工具总体AUC 0.78,敏感度0.60、特异度0.97;中/大型气胸AUC 0.93、敏感度0.89、特异度0.96。
  • AI整合系统使放射科确认气胸的报告中位时间由186分钟降至100分钟,降低46%(p<.001)。
  • AI对临床可处理的中/大型气胸诊断准确度较高,总体敏感度偏低(0.60)。

核心结论

  • AI整合系统在PACS内检测气胸并发出警报,对临床可处理的中/大型气胸达到较强AUC,同时大幅缩短放射科医生中位报告时间,有助于对可治疗危重情况更快临床响应。

研究设计与样本

  • 回顾性研究,纳入2020年8月至2021年4月连续采集的27,397张成人住院患者胸部正位单视图X线片;其中12,728张在AI整合系统内采集,14,669张在系统外采集;以最终放射科报告为参考标准行ROC分析,用Wilcoxon秩和检验评估AI整合警报系统对报告时间的影响。

诊断标准与关键数值

  • 以最终放射科报告为参考标准,AI工具检测气胸的AUC为0.78、敏感度0.60、特异度0.97;选择中/大型气胸时AUC升至0.93、敏感度0.89、特异度0.96。

临床应用与阅片要点

  • AI整合系统在PACS内对气胸发出警报,可使放射科医生确认气胸的报告中位时间由186分钟缩短至100分钟(降低46%,p<.001)。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

RATIONALE AND OBJECTIVES: Artificial intelligence (AI) algorithms in radiology capable of detecting urgent findings have gained significant traction in recent years, but the impact of these algorithms on real-world clinical practice remains unclear with need for scientific investigation. Our study investigates the diagnostic accuracy and impact on radiologist report turnaround times of an FDA-approved AI tool for pneumothorax (PTx) detection on inpatient chest X-rays (CXR) in our institution's radiology practice at a large academic medical center.

MATERIALS AND METHODS: This retrospective study included 27,397 frontal, single-view CXRs of adult inpatients collected consecutively between August 2020 and April 2021 following deployment of an AI-based PTx detection and picture archiving and communication system (PACS) alert system. 12,728 CXRs were acquired within the AI-integrated system while 14,669 CXRs were acquired outside of the system. Receiver operator characteristic (ROC) analysis was conducted with final radiology reports as the reference standard to evaluate diagnostic accuracy of the AI algorithm in detection of PTx. Wilcoxon rank sum tests were conducted to evaluate the effect of the AI-integrated alert system on radiologist reporting times.

RESULTS: Area under ROC curve (AUC) for the AI tool was.78 with sensitivity of .60 and specificity of .97. When selecting for moderate/large PTx, AUC, sensitivity and specificity increased to .93, .89 and .96, respectively. Median reporting time in CXRs with radiologist-confirmed PTx was reduced by 46% in those with AI integration as compared to those without AI integration (100 vs. 186 min, p < .001).

CONCLUSION: Real-world deployment of an AI-integrated system capable of detecting PTx and generating alerts within PACS achieved a strong AUC for clinically actionable PTx (i.e., moderate- or large-sized) while substantially reducing median radiologist reporting times, enabling swifter clinical response to a critical but treatable condition.

来源:Acad Radiol,查看原文。版权归原作者所有。

引用

  1. Hunter JG, Bera K, Shah N, et al. Real-World Performance of Pneumothorax-Detecting Artificial Intelligence Algorithm and its Impact on Radiologist Reporting Times. Acad Radiol. 2024. PMID: 39477746. doi:10.1016/j.acra.2024.10.012

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。