衡量汇总Meta分析与Meta回归结果在临床实践中统计学效度的指标
该文提出「统计学效度」概念,即所估计的参数等于新独立研究对应参数,并采用留一交叉验证技术构建新的效度统计量Vn并推导其分布。模拟研究比较Vn与Q统计量在单变量随机效应Meta分析和定制Meta回归模型中的性质,发现研究数≥50时两者性质相似,研究数较少时Vn把握度更高但1类错误率也更高。Vn应用于两项已发表Meta分析,作者认为在判断汇总估计在临床实践中的可能效度时,Vn可有用补充标准方法。
要点
- 提出统计学效度概念:所估计参数等于新独立研究对应参数。
- 用留一交叉验证构建效度统计量Vn并推导其分布。
- 研究数≥50时Vn与Q性质相似;研究数较少时Vn把握度更高但1类错误率更高。
核心结论
- 作者认为Vn在判断汇总Meta分析估计在临床实践中的可能效度时,可有用补充标准方法。
研究设计与样本
- 方法学研究,采用留一交叉验证技术构建效度统计量Vn并推导其分布,通过模拟研究比较Vn与Q统计量的性质,并应用于两项已发表Meta分析。
主要发现
- 模拟研究显示,研究数为50项或更多时,Vn与Q统计量的性质相似;研究数较少时,Vn把握度更高但1类错误率也高于Q。
- Vn的把握度和1类错误率取决于研究内方差、研究间方差、研究样本量和Meta分析中的研究数。
关键数值与推荐
- 统计学效度定义为所估计的参数等于新独立研究对应的参数。
- 研究数为50项或更多时,Vn与Q统计量的性质相似。
- 研究数较少时,Vn较Q把握度更高但1类错误率也更高。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
An important question for clinicians appraising a meta-analysis is: are the findings likely to be valid in their own practice-does the reported effect accurately represent the effect that would occur in their own clinical population? To this end we advance the concept of statistical validity-where the parameter being estimated equals the corresponding parameter for a new independent study. Using a simple ('leave-one-out') cross-validation technique, we demonstrate how we may test meta-analysis estimates for statistical validity using a new validation statistic, Vn, and derive its distribution. We compare this with the usual approach of investigating heterogeneity in meta-analyses and demonstrate the link between statistical validity and homogeneity. Using a simulation study, the properties of Vn and the Q statistic are compared for univariate random effects meta-analysis and a tailored meta-regression model, where information from the setting (included as model covariates) is used to calibrate the summary estimate to the setting of application. Their properties are found to be similar when there are 50 studies or more, but for fewer studies Vn has greater power but a higher type 1 error rate than Q. The power and type 1 error rate of Vn are also shown to depend on the within-study variance, between-study variance, study sample size, and the number of studies in the meta-analysis. Finally, we apply Vn to two published meta-analyses and conclude that it usefully augments standard methods when deciding upon the likely validity of summary meta-analysis estimates in clinical practice. © 2017 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd.
引用
- Willis BH, Riley RD. Measuring the statistical validity of summary meta-analysis and meta-regression results for use in clinical practice. Stat Med. 2017. PMID: 28620945. doi:10.1002/sim.7372
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。