使用两个患者队列数据对脑动脉瘤破裂概率模型进行外部验证
本研究利用两个患者队列共203例患者249个动脉瘤的影像与临床数据,对近期开发的统计动脉瘤破裂概率模型进行外部验证,评估其准确性、区分度与拟合优度。模型外部验证的AUC为0.82,训练队列乐观校正后AUC为0.84,误分类误差为0.24 vs 0.21。模型结合相似性方法后误分类误差降至0.14,结论认为模型具有良好泛化性,联合方法有潜力用于临床风险评估。
要点
- 模型外部验证区分度良好,AUC为0.82,训练队列乐观校正后AUC为0.84。
- 外部验证误分类误差为0.24,训练数据为0.21,准确性略有下降。
- 模型联合相似性方法后误分类误差降至0.14,作者认为有潜力用于临床风险评估。
核心结论
- 模型性能指标表明,对于不同临床机构获取的数据具有良好的泛化性。
- 结合基于模型和基于相似性的方法可进一步改善新病例的评估与解读,展示其临床风险评估的潜在用途。
研究设计与样本
- 外部验证研究,使用两个患者队列共203例患者249个动脉瘤的 segmented 影像数据和患者信息。
- 对患者进行个体化计算流体动力学模拟,并据此以准确性、区分度和拟合优度评估统计模型。
- 将模型性能与基于相似性的破裂评估方法进行比较,在训练队列中识别与外部队列给定动脉瘤在血流动力学和形态上相似的动脉瘤。
主要发现
- 模型应用于外部数据时达到良好的区分度和拟合优度,受试者工作特征曲线下面积 AUC = 0.82。
- 训练人群乐观校正后 AUC = 0.84,外部验证 AUC = 0.82,较训练人群仅轻度降低。
- 准确性指标显示,与训练数据相比准确性小幅下降,误分类误差为0.24 vs 0.21。
- 模型预测准确性在联合相似性方法后得到改善,误分类误差为0.14。
临床怎么用
- 作者认为,结合基于模型和基于相似性的方法可进一步改善新病例的评估与解读,展示其临床风险评估的潜在用途。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: For a treatment decision of unruptured cerebral aneurysms, physicians and patients need to weigh the risk of treatment against the risk of hemorrhagic stroke caused by aneurysm rupture. The aim of this study was to externally evaluate a recently developed statistical aneurysm rupture probability model, which could potentially support such treatment decisions. METHODS: Segmented image data and patient information obtained from two patient cohorts including 203 patients with 249 aneurysms were used for patient-specific computational fluid dynamics simulations and subsequent evaluation of the statistical model in terms of accuracy, discrimination, and goodness of fit. The model's performance was further compared to a similarity-based approach for rupture assessment by identifying aneurysms in the training cohort that were similar in terms of hemodynamics and shape compared to a given aneurysm from the external cohorts. RESULTS: When applied to the external data, the model achieved a good discrimination and goodness of fit (area under the receiver operating characteristic curve AUC = 0.82), which was only slightly reduced compared to the optimism-corrected AUC in the training population (AUC = 0.84). The accuracy metrics indicated a small decrease in accuracy compared to the training data (misclassification error of 0.24 vs. 0.21). The model's prediction accuracy was improved when combined with the similarity approach (misclassification error of 0.14). CONCLUSIONS: The model's performance measures indicated a good generalizability for data acquired at different clinical institutions. Combining the model-based and similarity-based approach could further improve the assessment and interpretation of new cases, demonstrating its potential use for clinical risk assessment.
引用
- Detmer FJ, Fajardo-Jiménez D, Mut F, et al. External validation of cerebral aneurysm rupture probability model with data from two patient cohorts. Acta Neurochir (Wien). 2018. PMID: 30374656. doi:10.1007/s00701-018-3712-8
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。