文献速递流行病学与生物统计真实世界研究与卫生经济

在动态系统评价中纳入非随机证据:COVID-NMA 计划的教训

Including nonrandomized evidence in living systematic reviews: lessons learned from the COVID-NMA initiative.
PubMed 文献 · J Clin Epidemiol · 2025-11-21

该研究比较了2020年12月至2021年11月间关于新冠疫苗对Delta变异株有效性的随机对照试验与非随机研究证据。期间仅1项RCT(6325名参与者)报告了疫苗效力,而52项非随机研究(68,010,961名参与者)报告了疫苗有效性。作者总结了在动态系统评价中纳入非随机证据的方法学挑战与应对经验。

要点

  • 2020年12月至2021年11月,仅1项RCT(6325人)报告新冠疫苗对Delta变异株的效力。
  • 同期52项非随机研究(68,010,961人)报告了疫苗对Delta变异株的有效性。
  • 动态系统评价中纳入非随机证据面临研究识别、数据重叠、病例定义不一致等挑战。

核心结论

  • 为在公共卫生紧急事件中保持响应性,动态系统评价应实施能够及时识别、评估并酌情整合随机与非随机证据的流程。

研究设计与样本

  • COVID-NMA 计划是一项国际性动态系统评价与Meta分析,持续综合新冠干预措施的证据。
  • 本研究识别了2020年12月(Delta变异株首次检测)至2021年11月(COVID-NMA最后一次非随机研究检索日期)期间所有报告疫苗对Delta变异株有效性的RCT和比较性非随机研究。
  • 研究开展了两个平行系统评价:一个聚焦RCT,另一个聚焦非随机研究,以比较关于疫苗对Delta变异株有效性的现有证据。
  • 研究还比较了纳入研究的发表时间线与Delta变异株全球流行率,并记录了在动态系统评价中纳入非随机研究的具体方法学挑战与解决方案。

主要发现

  • 2020年12月至2021年11月,仅1项RCT在6325名参与者的亚组中报告了疫苗对Delta变异株的效力。
  • 同期,52项非随机研究包括68,010,961名参与者,报告了疫苗对Delta变异株的有效性。

局限性

  • 在动态系统评价中纳入非随机研究面临诸多挑战:难以识别符合条件的研究。
  • 遇到重叠研究(即使用同一数据库的非随机研究)。
  • Delta变异株病例定义不一致。
  • 同一结局报告了多种分析和指标,但注册中心或方案中未预先指定主要分析。
  • 评估偏倚风险需要专业知识、标准化和培训。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND AND OBJECTIVES: Randomized controlled trials (RCTs) are more likely to be included in evidence syntheses of health interventions due to their methodological rigor. However, the integration of nonrandomized studies (NRSs) may be necessary, as was seen during the COVID-19 pandemic due to the emergence of variants of concern. We aimed to examine the body of evidence, randomized and nonrandomized, on COVID-19 vaccine effectiveness (VE) during the emergence of the Delta variant and to share lessons learned from including nonrandomized evidence alongside randomized evidence in the COVID-NMA living systematic review. STUDY DESIGN AND SETTING: The COVID-NMA initiative is an international, living systematic review and meta-analysis that continually synthesized evidence on COVID-19 interventions. For this study, we identified all RCTs and comparative NRSs reporting on VE against the Delta variant from December 2020 (its initial detection) through November 2021 (date of last COVID-NMA NRS search). We conducted two parallel systematic reviews: one focusing on RCTs and the other on NRSs to compare available evidence on VE against the Delta variant. We also compared the publication timelines of the included studies with the global prevalence of the Delta variant, and documented the specific methodological challenges and solutions when including NRSs in living systematic reviews. RESULTS: From December 2020 to November 2021, only one RCT reported vaccine efficacy against Delta in a subgroup of 6325 participants, while, during the same period, 52 NRSs including 68,010,961 participants reported VE against this variant. Nevertheless, including NRSs in our living systematic review posed several challenges. We faced difficulties in identifying eligible studies, encountered overlapping studies (ie, NRSs using the same database), and inconsistent definitions of Delta variant cases. Moreover, multiple analyses and metrics for the same outcome were reported without a pre-specified primary analysis in a registry or protocol. In addition, assessing the risk of bias required expertise, standardization, and training. CONCLUSION: To remain responsive during public health emergencies, living systematic reviews should implement processes that enable the timely identification, evaluation, and integration of both randomized and nonrandomized evidence where appropriate. PLAIN LANGUAGE SUMMARY: When new health treatments are tested, the best way to see how well they work is through randomized controlled trials (RCTs). These are carefully designed studies that help reduce bias. However, during the COVID-19 pandemic, scientists also had to rely on other types of studies called nonrandomized studies (NRS) based on real-world data because the virus was changing quickly and required urgent action. Our living systematic review examined how effective COVID-19 vaccines were against the Delta variant, which spread widely from late 2020 to 2021. We wanted to understand what both RCTs and NRSs revealed about vaccine protection at that time. We also aimed to learn about the benefits and challenges of including different kinds of studies. From December 2020 to November 2021, we found that only one RCT reported results specifically for the Delta variant, including just over 6000 people. However, during the same period, 52 NRSs, involving over 68 million people, shared results about vaccine effectiveness against Delta in real-world settings. Including these NRSs were important for answering questions quickly, but it also created challenges. For instance, it was sometimes unclear how studies should be included, as many used the same data sources. Different studies defined "Delta cases" in various ways and often reported several kinds of results without stating which one was most significant. Evaluating the quality of these studies was complex and required special training. We developed rules to handle each of these challenges. In this study, we found that while RCTs remain the gold standard, NRSs provided crucial information during a fast-moving public health emergency. To help patients, doctors, and policymakers get timely answers in the future, living systematic reviews should be designed to include both types of evidence when appropriate, using clear methods to address challenges.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Bonnet H, Higgins JPT, Chaimani A, et al. Including nonrandomized evidence in living systematic reviews: lessons learned from the COVID-NMA initiative. J Clin Epidemiol. 2025. PMID: 41276090. doi:10.1016/j.jclinepi.2025.112071

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。