文献速递医学教育与科研方法

AMSTAR 2 发布版缺乏评估统计方法适当性(条目11)与发表偏倚(条目15)的明确指导,且未反映 Meta 分析进展

The AMSTAR 2 publication lacks explicit instructions on how to assess the appropriateness of statistical methods (item 11) and publication bias (item 15) and does not reflect advances in meta-analysis.
PubMed 文献 · J Clin Epidemiol · 2025-09-24

本文为针对 AMSTAR 2 工具条目11(统计方法适当性)与条目15(发表偏倚)的评论文章。作者基于 Cochrane 手册和 Meta 分析方法学研究进展,指出这两条目在表述与实施上的问题,并提出细化决策点的建议。结论强烈推荐评价者评估系统综述统计方法时咨询 Meta 分析专家并参考 Cochrane 手册。

要点

  • AMSTAR 2 条目11与条目15缺乏明确操作指导,未反映 Meta 分析最新方法学进展。
  • 建议细化条目11决策点:随机效应模型适用性、Hartung-Knapp 校正与预测区间解释、统计异质性来源评估。
  • 建议细化条目15决策点:使用经验证工具评估缺失研究与结局风险,并恰当解释相关统计分析。

核心结论

  • 本文强烈推荐评价者在评估系统综述统计方法时咨询 Meta 分析专家,并参考定期更新的 Cochrane 手册。
  • 评价团队可将本文建议的细化内容作为预先确定条目11和条目15决策点的基础,以避免评级过程中的模糊性。

研究设计与样本

  • 本文为评论文章,针对 AMSTAR 2 工具中条目11(统计方法适当性)与条目15(发表偏倚)进行评述并提出细化建议。
  • 细化建议基于 Cochrane 手册总结的 Meta 分析方法学进展以及系统综述方法学研究。

主要发现

  • 本文在已有批评之外,进一步指出 AMSTAR 2 条目11和条目15在表述与实施中存在的问题与挑战。
  • 对条目11的细化涉及:基于文献检索的典型系统综述中随机效应模型的适当性、基于 Hartung-Knapp 校正和预测区间(当 Meta 分析至少纳入5项研究且统计异质性不过度时)解释汇总治疗效应、以及对统计异质性来源的审慎评估。
  • 对条目15的细化强调:使用经验证工具评估缺失研究与结局的风险、对相关统计分析(若应用)的恰当解释、以及对结论影响的确认。
  • 本文使用两篇已发表的系统综述帮助评价者正确应用细化后的条目11和条目15。

关键数值与推荐

  • 条目11细化建议包括评估随机效应模型对基于文献检索的典型系统综述是否适当。
  • 条目11细化建议包括当 Meta 分析至少纳入5项研究且统计异质性不过度时,基于 Hartung-Knapp 校正和预测区间解释汇总治疗效应。
  • 条目11细化建议包括对统计异质性来源进行审慎评估。
  • 条目15细化建议包括使用经验证工具评估缺失研究与结局的风险。
  • 条目15细化建议包括对相关统计分析(若应用)进行恰当解释,并确认对结论的影响。

临床怎么用

  • 本文强烈推荐评价者在评估系统综述统计方法时咨询 Meta 分析专家,并参考 Cochrane 手册。
  • 评价团队可将本文建议的细化内容作为预先确定条目11和条目15决策点的基础,以避免评级过程中的模糊性。

局限性

  • 原文未报告局限性

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND AND OBJECTIVES: As the quantity of published systematic reviews has increased substantially over the years, concerns about the methodological quality of this growing body of literature have been validly raised. AMSTAR 2, the updated version of AMSTAR, is an endorsed appraisal instrument aiming to critically assess the methodological aspects of a systematic review from conception to conduct and interpretation of the findings. However, since the publication of AMSTAR 2, several critiques have been expressed targeting various aspects of the instrument. The present commentary focuses on the AMSTAR 2 items that involve the appropriateness of statistical methods (item 11) and publication bias (item 15). METHODS: The refinements are based on the methodological advances in meta-analysis as summarized in the Cochrane Handbook and delineated in review methodological studies. RESULTS: Initially, the commentary outlines further issues and challenges with the formulation and implementation of AMSTAR 2 items 11 and 15, beyond those already raised by other authors. Then, refinements to the corresponding decision points of items 11 and 15 are suggested, with explanations for their importance in facilitating an evidence-based, transparent, and consistent evaluation among the involved appraisers. CONCLUSION: The commentary strongly recommends that appraisers consult with meta-analysts when assessing the statistical methods of a systematic review and refer to the Cochrane Handbook, as it is regularly updated with recent methodological advances in meta-analysis. The appraisal teams could use the suggested refinements as a basis to predetermine the decision points for items 11 and 15 that align with the statistical expectations of the assessed systematic review, thereby preventing any ambiguity during the rating process. PLAIN LANGUAGE SUMMARY: Systematic reviews have been established as an essential research design to detect knowledge gaps and prepare evidence-based clinical guidelines, among others. High reporting and methodological quality are crucial for systematic reviews to meet the intended goals. The rapid advances in systematic review methodology and software availability have led to a staggering number of published systematic reviews. Several empirical studies have already revealed limitations in the methodological and reporting quality of many systematic reviews from various medical fields. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement and AMSTAR (A MeaSurement Tool to Assess systematic Reviews) instrument were developed in response to the concerning number of systematic reviews with questionable quality. AMSTAR was updated to AMSTAR 2 in 2017 to meet the advances in the systematic review methodology. AMSTAR 2 has been widely used by several researchers to critically appraise the methodological quality of published systematic reviews. However, several authors have raised valid points regarding the wording and completeness of several items underlying the AMSTAR 2 tool. In the present commentary, I focus on items 11 and 15 of AMSTAR 2 that revolve around meta-analysis and publication bias. I propose significant refinements to meet the advances in meta-analysis and align with the Cochrane Handbook, which is a recognized standard in preparing, maintaining, and promoting high-quality systematic reviews. The proposed refinements for item 11 elaborate on the appropriateness of the random-effects model for a typical systematic review that is based on literature searches, the interpretation of the summary treatment effect based on the Hartung-Knapp adjustment and prediction interval (when at least five studies populate the meta-analysis and statistical heterogeneity is not excessive), and the diligent assessment of sources of statistical heterogeneity. The refinements of item 15 emphasize the assessment of the risk of missing studies and outcomes using a validated tool, the appropriate interpretation of the relevant statistical analyses (if applied), and the acknowledgment of the implications for the conclusions. I use two published systematic reviews to help the appraisers apply the refined items 11 and 15 correctly.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Spineli LM. The AMSTAR 2 publication lacks explicit instructions on how to assess the appropriateness of statistical methods (item 11) and publication bias (item 15) and does not reflect advances in meta-analysis. J Clin Epidemiol. 2025. PMID: 41005461. doi:10.1016/j.jclinepi.2025.111988

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。