机器学习预测静脉血栓栓塞症抗凝期间大出血:可能性与局限性
研究利用RIETE登记数据开发机器学习算法(最佳为XGBoost)预测静脉血栓栓塞症患者抗凝前3个月大出血,并与RIETE和VTE-BLEED评分比较。前瞻性验证队列中XGBoost的F1为15.4%,高于RIETE评分8.6%和VTE-BLEED评分6.4%;但外部验证队列中XGBoost的F1为5.2%,低于RIETE评分17.3%。
要点
- XGBoost在前瞻性验证队列中F1为15.4%,优于RIETE评分8.6%和VTE-BLEED评分6.4%。
- 外部验证队列中XGBoost的F1为5.2%,低于RIETE评分17.3%和VTE-BLEED评分9.75%。
- 机器学习模型性能仅在部分队列优于传统评分,外部验证未重现优势。
核心结论
- XGBoost算法性能仅在前瞻性验证队列中优于RIETE和VTE-BLEED评分,在外部验证队列中未优于这些评分。
研究设计与样本
- 使用RIETE登记数据开发机器学习算法,以55个基线变量为预测因子,学习数据来自49587例患者,其中873例(1.8%)发生大出血。
- 使用RIETE前瞻性收集的新数据进一步验证,并用COMMAND-VTE数据库进行外部验证;以RIETE和VTE-BLEED评分作为比较。
主要发现
- 前瞻性验证队列中XGBoost的敏感度、特异度、阳性预测值和F1评分分别为33.2%、93%、10%和15.4%。
- 前瞻性验证队列中RIETE评分的F1值为8.6%,VTE-BLEED评分的F1值为6.4%。
- 外部验证队列中XGBoost的敏感度、特异度、阳性预测值和F1评分分别为10.3%、87.6%、3.5%和5.2%。
- 外部验证队列中RIETE评分的F1值为17.3%,VTE-BLEED评分的F1值为9.75%。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Predictive tools for major bleeding (MB) using machine learning (ML) might be advantageous over traditional methods. We used data from the Registro Informatizado de Enfermedad TromboEmbólica (RIETE) to develop ML algorithms to identify patients with venous thromboembolism (VTE) at increased risk of MB during the first 3 months of anticoagulation. A total of 55 baseline variables were used as predictors. New data prospectively collected from the RIETE were used for further validation. The RIETE and VTE-BLEED scores were used for comparisons. External validation was performed with the COMMAND-VTE database. Learning was carried out with data from 49 587 patients, of whom 873 (1.8%) had MB. The best performing ML method was XGBoost. In the prospective validation cohort the sensitivity, specificity, positive predictive value and F1 score were: 33.2%, 93%, 10%, and 15.4% respectively. F1 value for the RIETE and VTE-BLEED scores were 8.6% and 6.4% respectively. In the external validation cohort the metrics were 10.3%, 87.6%, 3.5% and 5.2% respectively. In that cohort, the F1 value for the RIETE score was 17.3% and for the VTE-BLEED score 9.75%. The performance of the XGBoost algorithm was better than that from the RIETE and VTE-BLEED scores only in the prospective validation cohort, but not in the external validation cohort.
引用
- Mora D, Mateo J, Nieto JA, et al. Machine learning to predict major bleeding during anticoagulation for venous thromboembolism: possibilities and limitations. Br J Haematol. 2023. PMID: 36942630. doi:10.1111/bjh.18737
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。