文献速递流行病学与生物统计医学人工智能与信息学

基于Copula方法评估预测评分性能的数值策略

A numerical strategy to evaluate performance of predictive scores via a copula-based approach.
PubMed 文献 · Stat Med · 2020-05-11

针对相关性预测评分性能评估与比较的理论方法局限,本文提出一种基于Copula的通用数值框架,可模拟具有给定预测准确度(一致性指数或时间依赖AUC)的相关性预测评分,并用于评估多种预测准确度指标、研究检验统计量与置信区间的有限样本性质,以及通过交叉验证或bootstrap评估性能指标的乐观性。

要点

  • 提出基于Copula的数值框架,可模拟具有给定一致性指数或时间依赖AUC水平的相关性预测评分。
  • 该框架便于数值评估和比较相关性风险评分的多种预测准确度指标。
  • 可用于研究检验统计量和置信区间的有限样本性质,及评估性能指标的乐观性。

核心结论

  • 基于Copula的数值框架能有效模拟具有给定预测准确度水平的相关性预测评分,并支持评估与比较其预测性能。

研究设计与样本

  • 方法学研究,提出基于Copula的通用数值框架与算法,用于模拟相关性预测评分并评估其预测准确度。

主要发现

  • 新算法可有效模拟具有给定一致性指数或时间依赖AUC水平的相关性预测评分。
  • 该框架便于数值评估和比较相关性风险评分的多种预测准确度指标。
  • 该框架可用于研究检验统计量和置信区间的有限样本性质,以及通过交叉验证或bootstrap评估性能指标的乐观性。

临床怎么用

  • 为精准医学中相关性预测评分的性能评估与比较提供数值模拟工具。
  • 支持研究者在有限样本下评估检验统计量、置信区间及性能指标的乐观性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

Assessing and comparing the performance of correlated predictive scores are of current interest in precision medicine. Given the limitations of available theoretical approaches for assessing and comparing the predictive accuracy, numerical methods are highly desired which, however, have not been systematically developed due to technical challenges. The main challenges include the lack of a general strategy on effectively simulating many kinds of correlated predictive scores each with some given level of predictive accuracy in either concordance index or the area under a receiver operating characteristic curve area under the curves (AUC). To fill in this important knowledge gap, this paper is to provide a general copula-based numeric framework for assessing and comparing predictive performance of correlated predictive or risk scores. The new algorithms are designed to effectively simulate correlated predictive scores with given levels of predictive accuracy as measured in terms of concordance indices or time-dependent AUC for predicting survival outcomes. The copula-based numerical strategy is convenient for numerically evaluating and comparing multiple measures of predictive accuracy of correlated risk scores and for investigating finite-sample properties of test statistics and confidence intervals as well as assessing for optimism of given performance measures using cross-validation or bootstrap.

来源:Stat Med,查看原文。版权归原作者所有。

引用

  1. Zhang Y, Shao Y. A numerical strategy to evaluate performance of predictive scores via a copula-based approach. Stat Med. 2020. PMID: 32394520. doi:10.1002/sim.8566

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。