文献速递医学教育与科研方法

使用Cochrane修订版随机试验偏倚风险评估工具(RoB 2)有用但具有挑战性且资源密集:一项系统综述的观察

Risk-of-bias assessment using Cochrane's revised tool for randomized trials (RoB 2) was useful but challenging and resource-intensive: observations from a systematic review.
PubMed 文献 · J Clin Epidemiol · 2023-06-24

该研究在一项大型复杂干预系统综述中,由两名评价者独立应用RoB 2工具评估113项研究的860个关注结果并达成共识。每项研究平均耗时358分钟(SD 183),结果数和报告数及团队经验显著影响评估时间。作者认为RoB 2有用但资源密集且实施具有挑战性,建议改进实施指导。

要点

  • RoB 2评估113项研究的860个结果,每项研究平均耗时358分钟(SD 183)。
  • 每项研究的结果数(β=22)和报告数(β=14)及团队经验(β=-6)显著影响评估时间。
  • 作者认为RoB 2有用但资源密集且实施具有挑战性,改进实施指导可帮助评价者。

核心结论

  • RoB 2工具及其指导有用但资源密集且实施具有挑战性。
  • 批判性评价工具和报告指南应详细说明偏倚风险的实施细节。
  • 聚焦实施的改进指导可帮助评价者。

研究设计与样本

  • 在一项大型复杂干预系统综述中,两名评价者独立应用RoB 2评估关注结果并达成共识。
  • 记录评估耗时,并记录和讨论使用该工具的困难及所采用的解决方案。
  • 采用回归分析探索评估时间,并总结实施该工具的经验。

主要发现

  • 共评估113项研究中的860个关注结果。
  • 每项研究工作人员资源平均358分钟(SD 183)。
  • 每项研究的结果数(β=22)和报告数(β=14)及团队经验(β=-6)显著影响评估时间。

关键数值与推荐

  • 为一致实施该工具,制定了缺失数据的切点及关于缺失数据平衡的考虑。
  • 除非另有预防或调查,对干预偏离假定存在一些问题。
  • 对来自未设盲自我报告参与者的测量假定存在一些问题。
  • 尽管缺乏分析计划,对某些二分类结局判定为低选择偏倚风险。

局限性

  • 原文未报告局限性

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: To report our experience using version 2 of the Cochrane risk-of-bias tool for randomized trials (RoB 2). STUDY DESIGN AND SETTING: Two reviewers independently applied RoB 2 to results of interest in a large systematic review of complex interventions and reached consensus. We recorded the time taken, and noted and discussed our difficulties using the tool, and the resolutions we adopted. We explored the time taken with regression analysis and summarized our experience of implementing the tool. RESULTS: We assessed risk of bias in 860 results of interest in 113 studies. Staff resource averaged 358 minutes per study (SD 183). Number of results (β = 22) and reports (β = 14) per study and experience of the team (β = -6) significantly affected assessment time. To implement the tool consistently, we developed cut points for missingness and considerations of balance regarding missingness, assumed some concerns with intervention deviations unless otherwise prevented or investigated, some concerns with measurements from unblinded self-reporting participants, and judged low risk of selection for certain dichotomous outcomes despite the absence of an analysis plan. CONCLUSION: The RoB 2 tool and guidance are useful but resource-intensive and challenging to implement. Critical appraisal tools and reporting guidelines should detail risk of bias implementation. Improved guidance focusing on implementation could assist reviewers.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Crocker TF, Lam N, Jordão M, et al. Risk-of-bias assessment using Cochrane's revised tool for randomized trials (RoB 2) was useful but challenging and resource-intensive: observations from a systematic review. J Clin Epidemiol. 2023. PMID: 37364620. doi:10.1016/j.jclinepi.2023.06.015

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。