文献速递神经外周血管CT

在临床环境中评估人工智能检测颅内动脉瘤相对于神经放射科医师的准确性

Assessing the Accuracy of Artificial Intelligence in Detecting Intracranial Aneurysms in a Clinical Setting Relative to Neuroradiologists.
PubMed 文献 · AJNR Am J Neuroradiol · 2025-12-04

本研究回顾性分析2018年11月1日至2021年11月2日华盛顿大学医学中心2534例头或头颈CTA,评估商业AI工具(Aidoc)检测颅内动脉瘤的准确性。AI敏感度70.5%、特异度98.6%、准确率95.1%,神经放射科医师分别为94.0%、98.3%、97.8%;在Aidoc预期用途标准(未破裂、囊状、大于5mm)的35个动脉瘤中,AI敏感度85.7%、特异度98.6%、准确率98.4%,医师分别为97.1%、98.3%、98.3%。结论认为神经放射科医师在敏感度和准确率上优于AI,特异度相当。

要点

  • AI检测颅内动脉瘤敏感度70.5%,低于神经放射科医师的94.0%,特异度两者相当(98.6% vs 98.3%)。
  • 在Aidoc预期用途(未破裂、囊状、大于5mm)的35个动脉瘤中,AI敏感度85.7%,仍低于医师的97.1%。
  • AI总体准确率95.1%,低于医师的97.8%;在预期用途队列中AI准确率98.4%,与医师的98.3%相近。

核心结论

  • 神经放射科医师在颅内动脉瘤检测的敏感度和准确率上优于AI,特异度与AI相当。

研究设计与样本

  • 回顾性研究,从华盛顿大学医学中心临床数据库提取2018年11月1日至2021年11月2日的头或头颈CTA共2534例,使用Aidoc分析动脉瘤存在与否,以神经放射学报告为参照,分歧由3名神经放射科医师共识裁定。

诊断标准与关键数值

  • AI检测颅内动脉瘤的敏感度70.5%(95%CI 65.1%-75.5%)、特异度98.6%(95%CI 98.0%-99.0%)、准确率95.1%(95%CI 94.3%-95.9%)。
  • 神经放射科医师检测颅内动脉瘤的敏感度94.0%(95%CI 90.7%-96.3%)、特异度98.3%(95%CI 97.7%-98.8%)、准确率97.8%(95%CI 97.1%-98.3%)。
  • 在Aidoc预期用途标准(未破裂、囊状、大于5mm)的35个动脉瘤中,AI敏感度85.7%(95%CI 69.7%-95.2%)、特异度98.6%(95%CI 98.0%-99.0%)、准确率98.4%(95%CI 97.8%-98.8%)。
  • 在Aidoc预期用途标准的35个动脉瘤中,神经放射科医师敏感度97.1%(95%CI 85.1%-99.9%)、特异度98.3%(95%CI 97.7%-98.8%)、准确率98.3%(95%CI 97.7%-98.8%)。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

BACKGROUND AND PURPOSE: Intracranial aneurysms (IAs), detected in 2%-5% of the population, represent a major health care issue because ruptured aneurysms with resultant hemorrhage are associated with severe morbidity or mortality. With the increasing role of artificial intelligence (AI) in diagnostic radiology, we assessed the accuracy of a commercial AI tool (Aidoc) to detect intracranial aneurysms on head or head/neck CTA relative to fellowship-trained neuroradiologists.

MATERIALS AND METHODS: We retrospectively extracted CTA head or head/neck studies from University of Washington Medical Center's clinical database between November 1, 2018 and November 2, 2021; these were analyzed with Aidoc for evaluation of aneurysm presence. Concordance or discrepancies between AI and the neuroradiology reports were further adjudicated by 3 neuroradiologists for consensus. IA features including size, morphology, and site of origin were extracted for each positive case. Correlation between AI and neuroradiologist performance was assessed, and a vascular neurosurgeon independently reviewed neuroradiology false-negatives to determine IA management based on image and patient-specific features. Comparative analyses were also performed per Aidoc's intended use criteria, ie, "unruptured," "saccular" IAs greater than 5 mm in size.

RESULTS: A total of 2534 CTA scans were reviewed for IAs; 252 were positive with 315 IAs (1.25 aneurysms per positive CTA). AI achieved sensitivity, specificity, and accuracy of 70.5% (95% CI, 65.1%-75.5%), 98.6% (95% CI, 98.0%-99.0%), and 95.1% (95% CI, 94.3%-95.9%), respectively; while neuroradiologists' performance were 94.0% (95% CI, 90.7%-96.3%), 98.3% (95% CI, 97.7%-98.8%), and 97.8% (95% CI, 97.1%-98.3%), respectively. In the cohort, 35 IAs were within the intended use criteria for Aidoc, and here AI achieved sensitivity, specificity, and accuracy of 85.7% (95% CI, 69.7%-95.2%), 98.6% (95% CI, 98.0%-99.0%), and 98.4% (95% CI, 97.8%-98.8%) while neuroradiologists achieved 97.1% (95% CI, 85.1%-99.9%), 98.3% (95% CI, 97.7%-98.8%), and 98.3% (95% CI, 97.7%-98.8%), respectively.

CONCLUSIONS: Our multisite study showed that neuroradiologists performed better than AI for IA detection in terms of sensitivity and accuracy, while while achieving comparable specificity.

来源:AJNR Am J Neuroradiol,查看原文。版权归原作者所有。

引用

  1. Akinpelu BJ, Hassan MHD, Firoozeh N, et al. Assessing the Accuracy of Artificial Intelligence in Detecting Intracranial Aneurysms in a Clinical Setting Relative to Neuroradiologists. AJNR Am J Neuroradiol. 2025. PMID: 41298111. doi:10.3174/ajnr.A8897

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。