评估一种人工智能模型在头部CT上识别占位效应和血管源性水肿的表现
本研究回顾性评估人工智能模型(Annalise Enterprise CTB)在非增强头部CT上检测占位效应和血管源性水肿的独立性能,以多名神经放射科医师共识解读为参考标准。模型在薄层和厚层序列上检测占位效应的敏感度为95.3%–96.6%、特异度为89.8%–93.1%,检测血管源性水肿的敏感度为90.0%–90.2%、特异度为93.5%–95.5%,曲线下面积至少0.980。作者认为该模型可辅助临床工作流程,通过优先解读异常病例可能使患者获益。
要点
- 模型检测占位效应:薄层序列敏感度96.6%、特异度89.8%,厚层序列敏感度95.3%、特异度93.1%。
- 模型检测血管源性水肿:薄层序列敏感度90.2%、特异度93.5%,厚层序列敏感度90.0%、特异度95.5%。
- 对应曲线下面积至少0.980,作者认为可能通过优先解读异常病例辅助临床工作流程。
核心结论
- 该人工智能模型在本CT数据集中准确识别了占位效应和血管源性水肿,可能通过优先解读异常发现病例来辅助临床工作流程,并可能通过更早识别和后续治疗使患者获益。
研究设计与样本
- 回顾性独立性能评估,占位效应队列818例、血管源性水肿队列310例,数据来自美国5家医院2016年至2022年采集的18岁及以上患者非增强头部CT。
关键影像表现/征象
- 阳性病例依据原始临床报告通过自然语言处理和人工确认连续选取,阴性病例取同一CT扫描仪在阳性病例之后采集的下一例阴性病例。
- 每例由最多3名神经放射科医师独立解读以建立共识,医师获得完整CT检查;人工智能模型分别接收薄层(≤1.5 mm)和/或厚层(>1.5且≤5 mm)轴位序列。
诊断标准与关键数值
- 占位效应:薄层序列敏感度96.6%(95%CI,94.9%-98.2%)、特异度89.8%(95%CI,84.7%-94.2%);厚层序列敏感度95.3%(95%CI,93.5%-96.8%)、特异度93.1%(95%CI,89.1%-96.6%)。
- 血管源性水肿:薄层序列敏感度90.2%(95%CI,82.0%-96.7%)、特异度93.5%(95%CI,88.9%-97.2%);厚层序列敏感度90.0%(95%CI,84.0%-96.0%)、特异度95.5%(95%CI,92.5%-98.0%)。
- 对应曲线下面积至少0.980。
临床应用与阅片要点
- 作者认为该模型可辅助临床工作流程,通过优先解读异常发现病例,可能通过更早识别和后续治疗使患者获益。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND AND PURPOSE: Mass effect and vasogenic edema are critical findings on CT of the head. This study compared the accuracy of an artificial intelligence model (Annalise Enterprise CTB) with consensus neuroradiologists' interpretations in detecting mass effect and vasogenic edema.
MATERIALS AND METHODS: A retrospective stand-alone performance assessment was conducted on data sets of noncontrast CT head cases acquired between 2016 and 2022 for each finding. The cases were obtained from patients 18 years of age or older from 5 hospitals in the United States. The positive cases were selected consecutively on the basis of the original clinical reports using natural language processing and manual confirmation. The negative cases were selected by taking the next negative case acquired from the same CT scanner after positive cases. Each case was interpreted independently by up-to-three neuroradiologists to establish consensus interpretations. Each case was then interpreted by the artificial intelligence model for the presence of the relevant finding. The neuroradiologists were provided with the entire CT study. The artificial intelligence model separately received thin (≤1.5 mm) and/or thick (>1.5 and ≤5 mm) axial series.
RESULTS: The 2 cohorts included 818 cases for mass effect and 310 cases for vasogenic edema. The artificial intelligence model identified mass effect with a sensitivity of 96.6% (95% CI, 94.9%-98.2%) and a specificity of 89.8% (95% CI, 84.7%-94.2%) for the thin series, and 95.3% (95% CI, 93.5%-96.8%) and 93.1% (95% CI, 89.1%-96.6%) for the thick series. It identified vasogenic edema with a sensitivity of 90.2% (95% CI, 82.0%-96.7%) and a specificity of 93.5% (95% CI, 88.9%-97.2%) for the thin series, and 90.0% (95% CI, 84.0%-96.0%) and 95.5% (95% CI, 92.5%-98.0%) for the thick series. The corresponding areas under the curve were at least 0.980.
CONCLUSIONS: The assessed artificial intelligence model accurately identified mass effect and vasogenic edema in this CT data set. It could assist the clinical workflow by prioritizing interpretation of cases with abnormal findings, possibly benefiting patients through earlier identification and subsequent treatment.
引用
- Newbury-Chaet I, Mercaldo SF, Chin JK, et al. Evaluation of an Artificial Intelligence Model for Identification of Mass Effect and Vasogenic Edema on CT of the Head. AJNR Am J Neuroradiol. 2024. PMID: 38806239. doi:10.3174/ajnr.A8358
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。