生存或时间-事件预测模型性能评估统计方法综述:从传统到深度学习
本文综述了评估生存预测模型性能的统计方法,涵盖C指数(如Harrell C指数)、时间依赖ROC曲线分析、校准图、校准性能评估的其他方法以及Brier评分,旨在为研究和实践提供直观、概念性和实用的解释。
要点
- C指数用于评估生存模型的区分度,Harrell C指数是常用指标。
- 时间依赖ROC曲线可评估模型在不同时间点的区分性能。
- 校准图用于直观评估模型预测概率与实际风险的一致性。
诊断标准与关键数值
- C指数(如Harrell C指数)用于评估生存模型的区分度。
- 时间依赖ROC曲线分析用于评估模型在不同时间点的区分性能。
- 校准图用于评估模型预测概率与实际风险的一致性。
- Brier评分用于综合评估模型的预测误差。
临床应用与阅片要点
- 在评估生存预测模型时,应同时考虑区分度和校准度。
- C指数是衡量模型区分度的常用指标,但需结合校准图等评估校准性能。
- 时间依赖ROC曲线可反映模型在不同时间点的性能变化。
局限性
- 摘要未明确报告综述的检索策略和纳入文献范围,可能存在选择偏倚。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
The recent introduction of various high-dimensional modeling methods, such as radiomics and deep learning, has created a much greater diversity in modeling approaches for survival prediction (or, more generally, time-to-event prediction). The newness of the recent modeling approaches and unfamiliarity with the model outputs may confuse some researchers and practitioners about the evaluation of the performance of such models. Methodological literacy to critically appraise the performance evaluation of the models and, ideally, the ability to conduct such an evaluation would be needed for those who want to develop models or apply them in practice. This article intends to provide intuitive, conceptual, and practical explanations of the statistical methods for evaluating the performance of survival prediction models with minimal usage of mathematical descriptions. It covers from conventional to deep learning methods, and emphasis has been placed on recent modeling approaches. This review article includes straightforward explanations of C indices (Harrell's C index, etc.), time-dependent receiver operating characteristic curve analysis, calibration plot, other methods for evaluating the calibration performance, and Brier score.
引用
- Park SY, Park JE, Kim H, et al. Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches). Korean J Radiol. 2021. PMID: 34269532. doi:10.3348/kjr.2021.0223
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。