文献速递流行病学与生物统计医学教育与科研方法

Meta流行病学研究的有力证据表明:未能优化随机化和盲法(患者及结局评估者)的随机试验会高估效应

Compelling evidence from meta-epidemiological studies demonstrates overestimation of effects in randomized trials that fail to optimize randomization and blind patients and outcome assessors.
PubMed 文献 · J Clin Epidemiol · 2023-11-07

该系统调查纳入41项Meta流行病学研究,评估随机试验中潜在偏倚要素对效应估计的影响。随机序列生成不足(ROR 0.94,95%CI 0.90-0.97)和分配隐藏不足(ROR 0.92,95%CI 0.88-0.97)可能导致效应高估(中等确定性)。患者盲法缺失可能高估患者报告结局的效应(ROR 0.36,95%CI 0.28-0.48;中等确定性),结局评估者盲法缺失导致主观结局效应高估(ROR 0.69,95%CI 0.51-0.93;高确定性)。

要点

  • 随机序列生成不足和分配隐藏不足可能导致效应轻度高估(中等确定性)。
  • 患者盲法缺失可能大幅高估患者报告结局的效应(中等确定性)。
  • 结局评估者盲法缺失导致主观结局效应大幅高估(高确定性)。

核心结论

  • 未能确保随机序列生成或充分分配隐藏可能导致效应轻度高估。
  • 患者盲法缺失可能大幅高估患者报告结局的效应。
  • 结局评估者盲法缺失导致主观结局效应大幅高估。
  • 对于其他要素,尽管一致系统性高估效应的证据仍有限,但未能实施这些保障措施仍可能引入重要偏倚。

研究设计与样本

  • 对考察随机试验中潜在偏倚要素对效应估计影响的Meta流行病学研究进行系统调查。
  • 仅纳入保留Meta分析内试验聚类(试验间比较)或保留试验内子研究聚类(试验内比较)的Meta流行病学研究。
  • 共纳入41项Meta流行病学研究,其中34项为试验间比较,7项为试验内比较。
  • 分别从每项研究中提取比值比之比(ROR),并使用随机效应模型合并。
  • 基于GRADE和ICEMAN工具进行总体推断并评估证据确定性。

主要发现

  • 随机序列生成不足:ROR 0.94(95%CI 0.90-0.97),可能导致效应高估(中等确定性)。
  • 分配隐藏不足:ROR 0.92(95%CI 0.88-0.97),可能导致效应高估(中等确定性)。
  • 患者盲法缺失对患者报告结局:ROR 0.36(95%CI 0.28-0.48),可能高估效应(中等确定性)。
  • 结局评估者盲法缺失对主观结局:ROR 0.69(95%CI 0.51-0.93),导致效应高估(高确定性)。
  • 因获益提前终止的试验可能高估效应(中等确定性);协干预不平衡的试验可能高估效应,而结局数据缺失的试验可能低估效应(低确定性)。

关键数值与推荐

  • 随机序列生成不足:ROR 0.94(95%CI 0.90-0.97),中等确定性。
  • 分配隐藏不足:ROR 0.92(95%CI 0.88-0.97),中等确定性。
  • 患者盲法缺失对患者报告结局:ROR 0.36(95%CI 0.28-0.48),中等确定性。
  • 结局评估者盲法缺失对主观结局:ROR 0.69(95%CI 0.51-0.93),高确定性。
  • 因获益提前终止:中等确定性;协干预不平衡和结局数据缺失:低确定性。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 患者或结局评估者盲法对其他结局的影响,以及卫生保健提供者、数据收集者或数据分析者盲法的影响,仍不确定。
  • 基线不平衡、依从性、选择性报告和意向性治疗分析的影响仍不确定。
  • 对于其他要素,一致系统性高估效应的证据仍有限。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: To investigate the impact of potential risk of bias elements on effect estimates in randomized trials. STUDY DESIGN AND SETTING: We conducted a systematic survey of meta-epidemiological studies examining the influence of potential risk of bias elements on effect estimates in randomized trials. We included only meta-epidemiological studies that either preserved the clustering of trials within meta-analyses (compared effect estimates between trials with and without the potential risk of bias element within each meta-analysis, then combined across meta-analyses; between-trial comparisons), or preserved the clustering of substudies within trials (compared effect estimates between substudies with and without the element, then combined across trials; within-trial comparisons). Separately for studies based on between- and within-trial comparisons, we extracted ratios of odds ratios (RORs) from each study and combined them using a random-effects model. We made overall inferences and assessed certainty of evidence based on Grading of Recommendations, Assessment, development, and Evaluation and Instrument to assess the Credibility of Effect Modification Analyses. RESULTS: Forty-one meta-epidemiological studies (34 of between-, 7 of within-trial comparisons) proved eligible. Inadequate random sequence generation (ROR 0.94, 95% confidence interval [CI] 0.90-0.97) and allocation concealment (ROR 0.92, 95% CI 0.88-0.97) probably lead to effect overestimation (moderate certainty). Lack of patients blinding probably overestimates effects for patient-reported outcomes (ROR 0.36, 95% CI 0.28-0.48; moderate certainty). Lack of blinding of outcome assessors results in effect overestimation for subjective outcomes (ROR 0.69, 95% CI 0.51-0.93; high certainty). The impact of patients or outcome assessors blinding on other outcomes, and the impact of blinding of health-care providers, data collectors, or data analysts, remain uncertain. Trials stopped early for benefit probably overestimate effects (moderate certainty). Trials with imbalanced cointerventions may overestimate effects, while trials with missing outcome data may underestimate effects (low certainty). Influence of baseline imbalance, compliance, selective reporting, and intention-to-treat analysis remain uncertain. CONCLUSION: Failure to ensure random sequence generation or adequate allocation concealment probably results in modest overestimates of effects. Lack of patients blinding probably leads to substantial overestimates of effects for patient-reported outcomes. Lack of blinding of outcome assessors results in substantial effect overestimation for subjective outcomes. For other elements, though evidence for consistent systematic overestimate of effect remains limited, failure to implement these safeguards may still introduce important bias.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Wang Y, Parpia S, Couban R, et al. Compelling evidence from meta-epidemiological studies demonstrates overestimation of effects in randomized trials that fail to optimize randomization and blind patients and outcome assessors. J Clin Epidemiol. 2023. PMID: 37939743. doi:10.1016/j.jclinepi.2023.11.001

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。