文献速递医学教育与科研方法流行病学与生物统计

重新思考系统综述概览中的方法学评价:一种参与式验证框架

Rethinking methodological appraisal in overviews of systematic reviews: a participatory validation framework.
PubMed 文献 · J Clin Epidemiol · 2026-06-12

系统综述概览需要对纳入系统综述进行方法学评价,但即使使用AMSTAR 2或ROBIS等工具,不同团队评价仍存在显著差异,且作者身份可能影响判断。本文提出一种参与式验证框架,由概览作者独立评价后邀请纳入综述作者评论并重新评估,透明记录一致与分歧而不强求共识,以提升透明度和可解释性。

要点

  • 系统综述概览的方法学评价存在团队间差异,作者身份可能影响判断。
  • 参与式验证框架通过独立评价后邀请原作者评论并重评,透明记录一致与分歧。
  • 该框架旨在提升透明度而非达成单一确定性评级,可在现有工作流程中实施。

核心结论

  • 参与式验证框架通过透明记录评价一致与分歧,可提升系统综述概览方法学评价的透明度和可解释性。

研究设计与样本

  • 本文为评论性文章,提出一种参与式验证框架,未报告系统检索或样本量。

主要发现

  • 即使使用AMSTAR 2或ROBIS等标准化工具,不同研究团队的评价仍存在显著差异。
  • 系统综述作者身份或专业归属可能影响方法学评价,进而影响概览结论和可比性。

临床怎么用

  • 概览作者可先独立进行方法学评价,再邀请纳入系统综述作者评论并重新评估。
  • 将原始评价与原作者重评的一致和分歧透明记录,无需强求共识。

局限性

  • 框架的采用可能受选择性参与和行政负担限制。
  • 潜在的自利偏差需通过独立初始评价、匿名重评和透明报告来缓解。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Overviews of systematic reviews, or umbrella reviews, synthesize evidence across related research questions and inform clinical practice, policy, and research prioritization. A core component of overviews is the methodological appraisal of included systematic reviews, which guides interpretation, weighting of evidence, and confidence in conclusions. Although structured tools such as A Measurement Tool to Assess Systematic Reviews 2 (AMSTAR 2) and the Risk of Bias in Systematic Reviews (ROBIS) are commonly applied, these assessments remain interpretive, requiring judgment about reporting adequacy, methodological decisions, and the distinction between conduct and reporting limitations. Evidence shows substantial variability in ratings across research teams, even when using standardized instruments, and systematic review authorship or professional allegiance can influence appraisals, potentially affecting conclusions and comparability across overviews. DISCUSSION: To address these challenges, this commentary proposes a participatory validation framework in which overview authors conduct independent methodological appraisals and subsequently invite authors of included systematic reviews to comment on and reassess these judgments. Responses are compared with the original assessments, and areas of agreement and disagreement are transparently documented without requiring consensus. The framework is intended to enhance transparency and interpretability by making concordance and discordance visible rather than to establish a single definitive rating or resolve all disagreement. The framework is feasible within existing workflows, with minimal disruption beyond sharing assessments and documenting responses. Ethical considerations, such as potential self-serving bias, are mitigated through independent initial appraisal, anonymous reassessment, and transparent reporting. While adoption may be limited by selective participation and administrative burden, the framework represents a pragmatic, exploratory strategy to improve transparency, credibility, and interpretability of methodological appraisal in overviews, providing richer, more informative guidance for authors, guideline developers, policymakers, and the broader evidence synthesis community.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Faggion CM, Dummer PMH, Nagendrababu V, et al. Rethinking methodological appraisal in overviews of systematic reviews: a participatory validation framework. J Clin Epidemiol. 2026. PMID: 42285373. doi:10.1016/j.jclinepi.2026.112372

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。