文献速递流行病学与生物统计基础与转化研究

检验与预测模型临床效用的随机效应Meta分析

Random-effects meta-analysis of the clinical utility of tests and prediction models.
PubMed 文献 · Stat Med · 2018-03-25

本文提出用贝叶斯三变量随机效应Meta分析整合敏感度、特异度和患病率,在多种伤害-获益比下估计净获益及新场景中临床有用的概率,并以儿童发热耳温诊断和卵巢癌多变量预测模型两个案例说明临床效用存在跨场景异质性。

要点

  • 提出贝叶斯三变量随机效应Meta分析同时整合敏感度、特异度与患病率。
  • 可在不同伤害-获益比下汇总净获益并给出预测区间与有用概率。
  • 两个案例均显示临床效用跨场景异质,常规应用前应评估异质性。

核心结论

  • 提出贝叶斯三变量随机效应Meta分析方法,用于跨场景汇总检验或预测模型的净获益等临床效用指标。

研究设计与样本

  • 方法学研究,提出贝叶斯三变量随机效应Meta分析,整合敏感度、特异度与患病率。
  • 以两个案例说明:儿童发热耳温诊断已发表研究的Meta分析,以及卵巢癌多变量临床风险预测模型在多中心数据集的验证。

主要发现

  • 在选定的一系列伤害-获益比下,方法可给出净获益的汇总度量、预测区间及模型在新场景中临床有用的概率估计。
  • 预测区间与有用概率可在已知新场景患病率的条件下计算。
  • 两个案例中检验或模型的临床效用均存在跨场景异质性,限制了其实践应用价值。

临床怎么用

  • 在检验或预测模型常规实施前,应先评估其临床效用在不同场景间的异质性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

The use of data from multiple studies or centers for the validation of a clinical test or a multivariable prediction model allows researchers to investigate the test's/model's performance in multiple settings and populations. Recently, meta-analytic techniques have been proposed to summarize discrimination and calibration across study populations. Here, we rather consider performance in terms of net benefit, which is a measure of clinical utility that weighs the benefits of true positive classifications against the harms of false positives. We posit that it is important to examine clinical utility across multiple settings of interest. This requires a suitable meta-analysis method, and we propose a Bayesian trivariate random-effects meta-analysis of sensitivity, specificity, and prevalence. Across a range of chosen harm-to-benefit ratios, this provides a summary measure of net benefit, a prediction interval, and an estimate of the probability that the test/model is clinically useful in a new setting. In addition, the prediction interval and probability of usefulness can be calculated conditional on the known prevalence in a new setting. The proposed methods are illustrated by 2 case studies: one on the meta-analysis of published studies on ear thermometry to diagnose fever in children and one on the validation of a multivariable clinical risk prediction model for the diagnosis of ovarian cancer in a multicenter dataset. Crucially, in both case studies the clinical utility of the test/model was heterogeneous across settings, limiting its usefulness in practice. This emphasizes that heterogeneity in clinical utility should be assessed before a test/model is routinely implemented.

来源:Stat Med,查看原文。版权归原作者所有。

引用

  1. Wynants L, Riley RD, Timmerman D, et al. Random-effects meta-analysis of the clinical utility of tests and prediction models. Stat Med. 2018. PMID: 29575170. doi:10.1002/sim.7653

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。