快速综述方法学折衷对Meta分析与GRADE证据确信度的影响
本研究基于WHO慢性腰背痛指南的三项系统综述(针灸、教育、TENS),模拟快速综述的三种常见折衷(限制数据库、单评审筛选、单评审偏倚评估),比较治疗效应与GRADE证据确信度变化。结果显示折衷对推荐意见影响较小,但证据确信度在部分分析中发生13%至52%的改变,且难以预测。
要点
- 快速综述折衷对针灸和TENS的推荐意见无改变,教育综述有15.4%改变。
- 证据确信度在TENS综述中13.3%受影响,教育综述中51.6%,针灸综述中23.5%改变。
- 折衷导致部分描述性合成无法进行或Meta分析变为描述性合成,影响程度取决于研究问题广度与证据量。
核心结论
- 快速综述方法学折衷对治疗效应和证据确信度改变较少,但影响难以预测。
- 影响程度取决于研究问题广度、研究数量与质量以及综述主题。
研究设计与样本
- 基于三项WHO慢性原发性腰背痛非手术管理指南系统综述(针灸、教育、TENS),模拟三项快速综述。
- 评估三种折衷:限制数据库选择、单评审筛选、单评审偏倚风险评估。
主要发现
- 与WHO系统综述相比,针灸和TENS综述的Meta分析推荐意见无改变,教育综述有15.4%改变。
- 2.9%至51.6%的描述性合成因唯一研究被排除而未进行。
- 25.8%的描述性合成因单评审筛选假阳性变为Meta分析。
- 6.45%至13.33%的Meta分析因综述缩减为单一研究变为描述性合成。
- 证据确信度在TENS综述中13.3%受影响,教育综述中51.6%,针灸综述中23.5%改变。
临床怎么用
- 综述作者应尽可能减少比较组和结局数量、明确 eligibility 标准并减少方法学折衷。
- 当分析中仅纳入少量研究时,快速综述折衷对证据确信度影响更大,需谨慎解释。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To determine whether methodological trade-offs used in rapid reviews result in changes in treatment effects or Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) certainty of the evidence (COE) compared to systematic reviews. STUDY DESIGN AND SETTING: We used 3 systematic reviews on acupuncture, education, and transcutaneous electrical nerve stimulation (TENS) for the management of chronic low back pain (LBP) conducted to inform the World Health Organization (WHO) guideline on nonsurgical management of chronic primary LBP and simulated the conduct of 3 rapid reviews. We assessed the impact of 3 commonly used trade-offs: restricted database selection, single reviewer screening, and single reviewer risk of bias assessment. We meta-analyzed studies included for each rapid review and compared them to the results of the WHO systematic reviews and identified when treatment effects would change recommendations. We used evidence profiles to update any changes to GRADE criteria and resulting COE. RESULTS: Compared to the WHO systematic reviews, our rapid reviews resulted in no changes to recommendations based on the meta-analyses in the acupuncture or TENS reviews and 15.4% in the education review. Further, between 2.9% and 51.6% of descriptive syntheses were not performed because the single study in the analysis were excluded from the rapid review, 25.8% of descriptive syntheses became meta-analyses because of false positives from single reviewer screening, and 6.45%-13.33% of meta-analyses became descriptive syntheses because the review was reduced to a single study. The COE was affected in 13.3% in the TENS review and 51.6% in the education review due to descriptive syntheses that were not performed (exclusion of the single study in the analysis). In the acupuncture review, the COE changed in 23.5% of analyses. CONCLUSION: Rapid review methodological trade-offs led to few changes in treatment effects and COE. However, it is difficult to predict how they will impact quantitative and descriptive syntheses and COE because multiple factors are involved, including the breadth of the research question, volume and quality of studies, and review topic. When possible, review authors should consider few comparators and outcomes, well defined eligibility criteria and using fewer methodological trade-offs. PLAIN LANGUAGE SUMMARY: Rapid reviews synthesize evidence more efficiently than systematic reviews, but they use trade-offs, including searching fewer databases or using 1 instead of 2 reviewers. Our study investigated how these trade-offs affect the findings of rapid reviews on 3 treatments for chronic low back pain (acupuncture, education, and transcutaneous electrical nerve stimulation [TENS]). We reanalyzed 3 systematic reviews using 3 commonly used trade-offs, including limiting the database search, having 1 reviewer select studies instead of 2, and having 1 reviewer assess study quality. We then evaluated how these changes affected the validity of results and our confidence in the review conclusions. We found that these trade-offs changed few results. Up to 15.4% of the estimates from meta-analyses resulted in a change in recommendations for the education review, but none for the acupuncture or TENS reviews. In some cases, analyses could no longer be done because the study was missed, while others had to be described instead of analyzed statistically. The confidence in the evidence changed in 13% to 52% of analyses. In the acupuncture review, confidence in the evidence increased or decreased. In the education and TENS reviews, confidence in the evidence changed (to not applicable) in the analyses that could not be replicated due to missing studies. In summary, our findings suggest that rapid review trade-offs do not change many recommendations or the confidence in the evidence compared to full systematic reviews, except when there are few studies included in the analysis. The impact of using trade-offs depend on the research question, available evidence, and the quality of the studies. To improve the trustworthiness of rapid reviews, researchers should focus on a clearly defined research question, clear criteria for including studies, and limit the number of trade-offs.
引用
- Corso M, Brunton G, Negrini S, et al. Evaluating the impact of methodological trade-offs on meta-analyses and certainty of the evidence according to GRADE: part 5 of a meta-research study of rapid reviews. J Clin Epidemiol. 2026. PMID: 42697255. doi:10.1016/j.jclinepi.2026.112498
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。