文献速递神经外周血管CT

大血管闭塞人工智能计算机辅助分诊与通知算法的真实世界性能——卒中团队需要了解的内容

Real-World Performance of Large Vessel Occlusion Artificial Intelligence-Based Computer-Aided Triage and Notification Algorithms-What the Stroke Team Needs to Know.
PubMed 文献 · J Am Coll Radiol · 2023-05-16

在两个卒中中心回顾性评估两种FDA批准的大血管闭塞AI计算机辅助分诊与通知设备的真实世界性能,并与说明书中的厂商报告性能比较。医院A纳入704例,ICA和M1段敏感度85.3%、特异度91.9%,纳入M2后敏感度降至68.5%,纳入全部近端血管段后降至59.9%;医院B纳入642例,ICA和M1段敏感度90.7%、特异度97.9%,纳入M2后降至76.4%,纳入全部近端血管段后降至59.4%。

要点

  • 两中心真实世界敏感度均低于厂商报告值,且随纳入血管段范围扩大而明显下降。
  • 医院A ICA和M1段敏感度85.3%、特异度91.9%,厂商报告分别为97%和95.6%。
  • 医院B ICA和M1段敏感度90.7%、特异度97.9%,厂商报告分别为87.8%和89.6%。

核心结论

  • 两种FDA批准的大血管闭塞AI计算机辅助分诊与通知算法在真实世界中对颅内ICA和M1段以外血管及无结果或不可解读数据存在检测和沟通缺口。

研究设计与样本

  • 在两个独立卒中中心回顾性评估两种FDA批准的大血管闭塞AI计算机辅助分诊与通知设备的临床性能;连续纳入「code stroke」CT血管造影检查;以原始放射学报告为参考标准,由研究放射科医师提取数据。

诊断标准与关键数值

  • 医院A厂商报告评估颅内ICA和MCA,敏感度97%、特异度95.6%;真实世界704例(79例无CADt结果),ICA和M1段敏感度85.3%、特异度91.9%,纳入M2后敏感度降至68.5%,纳入全部近端血管段后降至59.9%。
  • 医院B厂商报告敏感度87.8%、特异度89.6%(未指定血管段);真实世界642例(20例无CADt结果),ICA和M1段敏感度90.7%、特异度97.9%,纳入M2后敏感度降至76.4%,纳入全部近端血管段后降至59.4%。

局限性

  • 原文为回顾性评估。
  • 部分病例无CADt结果(医院A 79例、医院B 20例)。
  • 存在无结果和不可解读数据的情况。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

PURPOSE: To evaluate the real-world performance of two FDA-approved artificial intelligence (AI)-based computer-aided triage and notification (CADt) detection devices and compare them with the manufacturer-reported performance testing in the instructions for use.

MATERIALS AND METHODS: Clinical performance of two FDA-cleared CADt large-vessel occlusion (LVO) devices was retrospectively evaluated at two separate stroke centers. Consecutive "code stroke" CT angiography examinations were included and assessed for patient demographics, scanner manufacturer, presence or absence of CADt result, CADt result, and LVO in the internal carotid artery (ICA), horizontal middle cerebral artery (MCA) segment (M1), Sylvian MCA segments after the bifurcation (M2), precommunicating part of cerebral artery, postcommunicating part of the cerebral artery, vertebral artery, basilar artery vessel segments. The original radiology report served as the reference standard, and a study radiologist extracted the above data elements from the imaging examination and radiology report.

RESULTS: At hospital A, the CADt algorithm manufacturer reports assessment of intracranial ICA and MCA with sensitivity of 97% and specificity of 95.6%. Real-world performance of 704 cases included 79 in which no CADt result was available. Sensitivity and specificity in ICA and M1 segments were 85.3% and 91.9%. Sensitivity decreased to 68.5% when M2 segments were included and to 59.9% when all proximal vessel segments were included. At hospital B the CADt algorithm manufacturer reports sensitivity of 87.8% and specificity of 89.6%, without specifying the vessel segments. Real-world performance of 642 cases included 20 cases in which no CADt result was available. Sensitivity and specificity in ICA and M1 segments were 90.7% and 97.9%. Sensitivity decreased to 76.4% when M2 segments were included and to 59.4% when all proximal vessel segments are included.

DISCUSSION: Real-world testing of two CADt LVO detection algorithms identified gaps in the detection and communication of potentially treatable LVOs when considering vessels beyond the intracranial ICA and M1 segments and in cases with absent and uninterpretable data.

来源:J Am Coll Radiol,查看原文。版权归原作者所有。

引用

  1. Kunst, Gupta, Coombs, et al. Real-World Performance of Large Vessel Occlusion Artificial Intelligence-Based Computer-Aided Triage and Notification Algorithms-What the Stroke Team Needs to Know. J Am Coll Radiol. 2023. PMID: 37196818. doi:10.1016/j.jacr.2023.04.003

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。