文献速递流行病学与生物统计医学教育与科研方法

偏倚风险工具1与工具2的比较及其对网状Meta分析结果的影响——基于一项银屑病Cochrane动态系统评价的案例研究

Comparison between risk of bias-1 and risk of bias-2 tool and impact on network meta-analysis results-A case study from a living Cochrane review on psoriasis.
PubMed 文献 · J Clin Epidemiol · 2025-12-04

本研究在2025年更新的银屑病Cochrane动态系统评价中,由四对评估者使用RoB-2工具评价193项随机对照试验的偏倚风险,计算评估者间信度并与RoB-1判定比较,通过敏感性分析探索两种工具判定差异对网状Meta分析结果的影响。结果显示RoB-2总体评估者间信度fair至moderate,两工具判定存在显著差异,排除高偏倚风险试验后对PASI 90疗效结果影响中等,对严重不良事件结果影响更明显。

要点

  • RoB-2总体评估者间信度:PASI 90为fair(kappa=0.37),严重不良事件为moderate(kappa=0.46)。
  • 与RoB-1相比,RoB-2将更少结果评为低偏倚风险:PASI 90为36% vs 58%,严重不良事件为13% vs 58%。
  • 排除高偏倚风险试验后,PASI 90的网状Meta分析结果变化中等(中位RRR=0.92),严重不良事件变化更宽(中位RRR=1.07)。

核心结论

  • 在大型Cochrane系统评价中转向RoB-2显示fair至moderate的评估者间信度,强调评估者间需达成共识。
  • 从RoB-1到RoB-2的转变导致本评价中偏倚风险判定发生变化。
  • 尽管对严重不良事件的网状Meta分析结果影响明显,但对疗效结局PASI 90的结果变化有限。

研究设计与样本

  • 本研究在2025年更新的银屑病全身治疗Cochrane动态系统评价内开展。
  • 四对评估者使用RoB-2工具评价193项随机对照试验两个主要结局的偏倚风险:PASI 90和严重不良事件。
  • 采用Cohen kappa计算评估者间信度。
  • 将147项试验(PASI 90)和154项试验(严重不良事件)的RoB-2判定与Cochrane 2023更新版的RoB-1评估进行比较。
  • 通过敏感性分析探索RoB-2与RoB-1判定对网状Meta分析结果的影响,计算每个治疗效应的风险比比值(RRR)。

主要发现

  • RoB-2总体判定的评估者间信度:PASI 90为fair(kappa=0.37),严重不良事件为moderate(kappa=0.46)。
  • 各领域间评估者间信度从kappa=0.33至kappa=0.65不等,领域2、3和5的信度较低。
  • 与RoB-1相比,RoB-2将更小比例的结果评为低偏倚风险:PASI 90为36% vs 58%,严重不良事件为13% vs 58%;将更高比例的严重不良事件评为高偏倚风险:55% vs 29%。
  • PASI 90有66/147(45%)项研究出现判定切换,包括18次从低到高或从高到低的极端切换;严重不良事件有93/154(60%)项研究出现判定切换,其中32次极端切换均为从低到高。
  • 排除高偏倚风险试验的敏感性分析显示对网状Meta分析疗效结果影响中等(中位RRR=0.92,四分位距0.91-0.92),但对严重不良事件变化更宽(中位RRR=1.07,四分位距0.97-1.15)。

关键数值与推荐

  • RoB-2总体判定评估者间信度:PASI 90的kappa=0.37(fair),严重不良事件的kappa=0.46(moderate)。
  • 各领域评估者间信度范围:kappa=0.33至kappa=0.65,领域2、3和5较低。
  • RoB-1与RoB-2判定低偏倚风险比例:PASI 90为58% vs 36%,严重不良事件为58% vs 13%。
  • RoB-1与RoB-2判定高偏倚风险比例(严重不良事件):29% vs 55%。
  • 敏感性分析中位RRR:PASI 90为0.92(IQR 0.91-0.92),严重不良事件为1.07(IQR 0.97-1.15)。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: This study was conducted within a large Cochrane living systematic review (SR) on psoriasis treatments with the aim to evaluate the inter-rater agreement of the Cochrane risk of bias tool 2 (RoB-2) tool, to compare its RoB judgments with the original RoB-1, and to explore the impact of changes in RoB judgment between the two tools on the Cochrane network meta-analysis' (NMA) results. STUDY DESIGN AND SETTING: This study was conducted within the 2025 update of a living Cochrane review on systemic treatments for psoriasis. Four pairs of assessors used RoB-2 to evaluate the RoB of 193 randomized controlled trials for two primary outcomes: Psoriasis Area Severity Index (PASI) 90 (reflecting clear or almost clear skin) and serious adverse events (SAEs). Inter-rater reliability (IRR) was calculated using Cohen's kappa. RoB-2 judgments for 147 trials (PASI 90) and 154 trials (SAEs) were compared to the previous RoB-1 assessments from the Cochrane 2023 update. The impact of using RoB-2 vs. RoB-1 judgments on the NMA's results was explored through sensitivity analyses, with calculation of ratio of risk ratios (RRRs) between the analyses for each treatment effect. RESULTS: For the RoB-2 overall judgment, the IRR was fair for PASI 90 (kappa = 0.37) and moderate for SAEs (kappa = 0.46). IRR varied between domains (from kappa = 0.33, to kappa = 0.65), with lower IRR found for domains 2, 3, and 5. Significant discrepancies were found between RoB-1 and RoB-2 judgments. Compared to RoB-1, RoB-2 rated a smaller proportion of results as low risk for both PASI 90 (36% vs 58%) and SAEs (13% vs 58%) and a higher proportion as high risk for SAEs (55% vs 29%). For PASI 90, 66/147 (45%) studies showed switches between different judgments, including 18 extreme switches either from low to high or from high to low RoB. For SAEs, 93/154 (60%) studies underwent switches between different judgments, with 32 extreme switches occurring exclusively from low to high RoB. Sensitivity analyses excluding high-risk trials showed moderate impact on the NMA efficacy results (median RRR = 0.92, interquartile range (IQR), 0.91-0.92), but wider changes for SAEs (median RRR = 1.07, IQR, 0.97-1.15). CONCLUSION: The transition to RoB-2 in a large Cochrane SR revealed fair-to-moderate inter-rater agreement, underscoring the need for consensus among reviewers. The shift from RoB-1 to RoB-2 led to changes in risk-of-bias judgments in our review. Although the impact on the NMA results was pronounced for SAEs, the changes in results were limited for our efficacy outcome PASI 90.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Guelimi R, Choudhary C, Ollivier C, et al. Comparison between risk of bias-1 and risk of bias-2 tool and impact on network meta-analysis results-A case study from a living Cochrane review on psoriasis. J Clin Epidemiol. 2025. PMID: 41352579. doi:10.1016/j.jclinepi.2025.112097

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。