对干预性系统评价样本中偏倚风险评估的分析,第二部分:聚焦偏倚风险评估工具,发现少数符合当前评价标准
本研究分析2014至2021年发表的126篇脑性瘫痪干预系统评价中使用的偏倚风险评估工具,评估其是否符合AMSTAR-2第9条标准。在37个工具中,针对随机对照试验,所有Cochrane工具、原始及修改版Downs和Black清单、Ding等交叉研究质量评价标准完全符合;针对非随机干预研究,所有Cochrane工具、原始及修改版Downs和Black清单、Research Triangle Institute条目库完全符合。作者建议系统评价作者选用当代偏倚风险评估工具,避免过度修改。
要点
- 37个偏倚风险评估工具中,仅部分完全符合AMSTAR-2第9条对随机对照试验和非随机干预研究的评价标准。
- 针对随机对照试验,所有Cochrane工具、原始及修改版Downs和Black清单、Ding等交叉研究标准完全符合。
- 针对非随机干预研究,所有Cochrane工具、原始及修改版Downs和Black清单、Research Triangle Institute条目库完全符合。
核心结论
- 据作者所知,这是首个按AMSTAR-2第9条评价标准为系统评价作者提供偏倚风险评估工具适当性与充分性实用信息的资源。
- 作者提出类似方法用于评价应用于单病例实验设计的工具。
- 作者鼓励系统评价作者寻求为医疗相关干预系统评价开发的当代偏倚风险评估工具,并设计用于评估相关研究设计特征。
- 工具应针对综述主题和研究问题特有的属性,但不应进行不合理和过度的修改。
- 作者提倡认识Cochrane和非Cochrane偏倚风险评估工具的潜在缺点,即使那些按AMSTAR-2第9条评价标准表现良好的工具。
研究设计与样本
- 研究纳入2014至2021年发表的126篇脑性瘫痪干预系统评价,识别其中报告的偏倚风险评估工具。
- 合格工具为已用于评估这些系统评价纳入的原始研究、且评估结果报告足够详细以允许评价的工具。
- 研究识别工具版本为原始、修改或新型,并确定工具开发者意图适用的研究设计。
- 研究评价工具评估AMSTAR-2第9条规定的随机对照试验和非随机干预研究四种偏倚来源的潜在能力,并调整第9条以评价单病例实验设计工具。
主要发现
- 大多数合格工具在已发表文献中按名称被认可,并以原始或修改形式应用;修改在不同样本间变异较大。
- 在检查的37个工具中,完全符合随机对照试验评价标准的包括所有Cochrane工具、原始和修改版Downs和Black清单、Ding等交叉研究质量评价标准。
- 完全符合非随机干预研究评价标准的包括所有Cochrane工具、原始和修改版Downs和Black清单、Research Triangle Institute非随机干预研究偏倚风险与精确性条目库。
- 一般而言,为特定研究设计开发的工具被判定为该设计完全或部分符合评价标准。
- 结果表明,单一工具不太可能按AMSTAR-2第9条评价标准充分适用于包含多种设计研究的干预系统评价。
关键数值与推荐
- AMSTAR-2第9条评价偏倚风险评估工具充分处理偏倚来源的能力,尤其针对随机对照试验和非随机干预研究。
- 完全符合随机对照试验评价标准的工具:所有Cochrane工具、原始和修改版Downs和Black清单、Ding等交叉研究质量评价标准。
- 完全符合非随机干预研究评价标准的工具:所有Cochrane工具、原始和修改版Downs和Black清单、Research Triangle Institute非随机干预研究偏倚风险与精确性条目库。
临床怎么用
- 作者鼓励系统评价作者寻求为医疗相关干预系统评价开发的当代偏倚风险评估工具,并设计用于评估相关研究设计特征。
- 作者认为工具应针对综述主题和研究问题特有的属性,但不应进行不合理和过度的修改。
- 作者提倡认识Cochrane和非Cochrane偏倚风险评估工具的潜在缺点,即使那些按AMSTAR-2第9条评价标准表现良好的工具。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Risk of bias (RoB) assessment is a critical part of any systematic review (SR). There are multiple tools available for assessing RoB of the studies included in a SR. The conduct of these assessments in intervention SRs are addressed by three items in AMSTAR-2, considered the preferred tool for critically appraising an intervention SR. This study focuses attention on item 9, which assesses the ability of a RoB tool to adequately address sources of bias, particularly in randomized trials (RCTs) and nonrandomized studies of interventions (NRSI). Our main objective is to report the detailed results of our examination of both Cochrane and non-Cochrane RoB tools and distinguish those that meet AMSTAR-2 item 9 appraisal standards. STUDY DESIGN AND SETTING: We identified critical appraisal tools reported in a sample of 126 SRs reporting on interventions for persons with cerebral palsy published from 2014 to 2021. Eligible tools were those that had been used to assess the primary studies included in these SRs and for which assessment results were reported in enough detail to allow appraisal of the tool. We identified the version of the tool applied as original, modified, or novel and established the applicable study designs as intended by the tools' developers. We then evaluated the potential ability of these tools to assess the four sources of bias specified in AMSTAR-2 item 9 for RCTs and NRSI. We adapted item 9 to appraise tools applied to single-case experimental designs, which we also encountered in this sample of SRs. RESULTS: Most of the eligible tools are recognized by name in the published literature and were applied in the original or modified form. Modifications were applied with considerable variability across the sample. Of the 37 tools we examined, those judged to fully meet the appraisal standards for RCTs included all the Cochrane tools, the original and modified Downs and Black Checklist, and the quality assessment standard for a cross-over study by Ding et al; for NRSI, these included all the Cochrane tools, the original and modified Downs and Black Checklist, and the Research Triangle Institute item bank on Risk of Bias and Precision of Observational Studies for NRSI. In general, tools developed for a specific study design were judged to meet the appraisal standards fully or partially for that design. These results suggest it is unlikely that a single tool will be adequate by AMSTAR-2 item 9 appraisal standards for an intervention SR that includes studies of various designs. CONCLUSION: To our knowledge, this is the first resource providing SR authors with practical information about the appropriateness and adequacy of RoB tools by the appraisal standards specified in AMSTAR-2 item 9 for RCTs and NRSI. We propose similar methods for appraisal of tools applied to single-case experimental design. We encourage authors to seek contemporary RoB tools developed for use in healthcare-related intervention SRs and designed to evaluate relevant study design features. The tools should address attributes unique to the review topic and research question but not be subjected to unjustified and excessive modifications. We promote recognition of the potential shortcomings of both Cochrane and non-Cochrane RoB tools, even those that perform well by AMSTAR-2 item 9 appraisal standards.
引用
- Kolaski K, Clarke M, Logan LR, et al. Analysis of risk of bias assessments in a sample of intervention systematic reviews, Part II: focus on risk of bias tools reveals few meet current appraisal standards. J Clin Epidemiol. 2024. PMID: 39025376. doi:10.1016/j.jclinepi.2024.111460
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。