文献速递流行病学与生物统计

在随机对照试验的Meta分析中纳入非随机干预研究改变了超过三分之一研究的估计值:一项实证分析

Including non-randomized studies of interventions in meta-analyses of randomized controlled trials changed the estimates in more than a third of the studies: evidence from an empirical analysis.
PubMed 文献 · J Clin Epidemiol · 2025-05-05

该实证分析检索了2017年12月9日至2022年12月9日发表的、在同一结局下同时纳入随机对照试验(RCT)和非随机干预研究(NRSI)的系统综述,重新分析了217个Meta分析。结果显示,78个Meta分析(35.9%)中RCT-only与RCT+NRSI合并估计值出现定性不一致,其中69个(88.5%)在纳入NRSI后获得统计学显著性;NRSI纳入使异质性从21.8%升至36.9%,RCT在合并估计中的权重中位数为33.9%。

要点

  • 35.9%的Meta分析在纳入NRSI后定性结论改变,其中88.5%由不显著变为显著。
  • 纳入NRSI使异质性从21.8%升至36.9%,RCT权重中位数仅33.9%。
  • 作者提示合并RCT与NRSI的Meta分析需谨慎解读,尤其RCT不显著而合并后显著时。

核心结论

  • 研究结果提示,在开展和解读合并RCT与NRSI的Meta分析时需谨慎,尤其当RCT结果不显著而纳入NRSI后达到统计学显著时。

研究设计与样本

  • 检索PubMed中2017年12月9日至2022年12月9日发表的、在同一结局下同时纳入RCT和NRSI的系统综述,共识别220篇符合条件的系统综述,重新分析217个Meta分析。
  • 采用DerSimonian-Laird随机效应模型重新分析合并估计值,比较RCT-only与RCT+NRSI的合并结果,考察点估计值、亚组差异、统计异质性及RCT在合并估计中的权重变化。
  • 若两种估计值在同一方向上均具统计学显著性或均未达统计学显著性,则定义为定性一致。

主要发现

  • 78个Meta分析(35.9%)中RCT-only与RCT+NRSI合并估计值出现定性不一致,其中69个(88.5%)在纳入NRSI后获得统计学显著性。
  • 58个Meta分析(26.7%)的点估计值未达到预设的一致性标准,32个Meta分析(14.8%)中RCT与NRSI之间存在统计学显著的亚组差异。
  • 纳入NRSI使异质性从21.8%升至36.9%,RCT在合并估计中的权重中位数为33.9%。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: There is a growing trend to include nonrandomized studies of interventions (NRSIs) in meta-analyses of randomized controlled trials (RCTs) for health decision-making. The study aimed to quantify the impact of integrating NRSI on the evidence derived from RCTs within the same systematic review. STUDY DESIGN AND SETTING: We searched PubMed for systematic reviews published between December 9, 2017, and December 9, 2022, that included both RCTs and NRSIs under the same outcome. Using the DerSimonian-Laird random-effects model, we reanalyzed the pooled estimates to compare those derived from RCTs with those from combined RCTs and NRSIs. We examined changes in point estimates, subgroup differences, statistical heterogeneity, and the weight of RCTs in pooled estimates. Results were defined as being in qualitative agreement if both estimates demonstrated statistical significance in the same direction or if neither achieved statistical significance. RESULTS: A total of 220 eligible systematic reviews were identified and 217 meta-analyses were reanalyzed. Qualitative disagreement between RCTs only and pooled estimates combining RCTs and NRSIs was observed in 78 meta-analyses (35.9%), of which 69 (88.5%) gained statistical significance after the inclusion of NRSIs. Point estimates in 58 meta-analyses (26.7%) failed to meet predefined agreement criteria, and statistically significant subgroup differences between RCTs and NRSIs were identified in 32 meta-analyses (14.8%). The incorporation of NRSIs raised the heterogeneity from 21.8% to 36.9%, whereas RCTs accounted for a median weight of 33.9% in the pooled estimates. CONCLUSION: These findings highlight the need for caution in conducting and interpreting meta-analyses combining RCTs and NRSIs, particularly in scenarios where RCTs yield nonsignificant results whereas the inclusion of NRSIs achieves statistical significance. PLAIN LANGUAGE SUMMARY: Although randomized controlled trials (RCTs) remain the gold standard for clinical evidence, they are often insufficient to address complex clinical questions. Nonrandomized studies of interventions (NRSIs), leveraging real-world clinical data, are increasingly used to supplement RCT findings. Despite growing interest in integrating NRSIs into meta-analyses with RCTs, the clinical and statistical implications of this approach remain uncertain. To address this gap, we conducted a systematic evaluation of how NRSI inclusion impacts meta-analytic results by analyzing 220 systematic reviews that combined RCTs and NRSIs under the same outcome. Our analysis revealed that incorporating NRSIs altered effect estimates in over one-third of cases, with 88.5% of meta-analyses achieving statistical significance only after NRSI inclusion-a finding with critical implications for decision-making. In addition, NRSI integration elevated statistical heterogeneity, although RCTs accounted for less than one-third of the weight in pooled estimates. These findings collectively underscore the necessity for robust evaluation and cautious interpretation when merging NRSI data with RCTs in meta-analyses.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Yao M, Mei F, Ma Y, et al. Including non-randomized studies of interventions in meta-analyses of randomized controlled trials changed the estimates in more than a third of the studies: evidence from an empirical analysis. J Clin Epidemiol. 2025. PMID: 40334718. doi:10.1016/j.jclinepi.2025.111815

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。