指南与共识医学教育与科研方法流行病学与生物统计

评估临床实践指南对推荐分级的评估、制定与评价方法的依从性:标准及其应用的系统综述

Evaluation of grading of recommendations assessment, development, and evaluation approach adherence in clinical practice guidelines: a systematic survey of criteria and their applications.
指南 / 共识 · J Clin Epidemiol · 2026-02-19

该系统综述检索2004年1月至2024年11月文献,纳入11篇提出或应用GRADE依从性评价标准的文献,归纳出10个离散条目,发现现有标准在制定方法、用户测试和指导手册方面存在不足,且所评估指南在10个条目中5个的中位依从率不理想。

要点

  • 现有GRADE依从性评价标准异质且可用性欠佳,多未报告制定方法或提供用户测试与手册。
  • 最常涉及的条目为证据确定性评价标准与推荐制定标准(8篇中7篇)。
  • 所评估指南在10个条目中5个的中位依从率不理想,关键领域应用缺口明显。

核心结论

  • 现有评估GRADE依从性的标准多样且可用性欠佳,基于这些标准的评估显示声称使用GRADE的指南在关键领域存在显著应用缺口。
  • 作者认为需要开发结构化、经用户测试的评估工具,并改善GRADE在临床实践指南中的实施。

研究设计与样本

  • 系统综述,系统检索PubMed、Embase、Web of Science和Cochrane Library从2004年1月至2024年11月的文献,并手动查阅GRADE手册及相关网站。
  • 纳入提出或应用GRADE依从性评价标准的文献,共识别11篇符合条件文献:8篇提出评价标准(其中4篇应用自身标准评估指南),3篇应用现有标准。

主要发现

  • 从这些标准中归纳出10个可清晰区分的条目,可用于定义对GRADE的良好依从。
  • 最常涉及的条目为证据确定性评价标准和推荐制定标准(8篇中7篇),而问题构建与结局选择及重要性评级较少见(8篇中3篇)。
  • 8篇提出标准的文献中,4篇未报告其制定方法和应答选项,且均未进行用户测试或提供指导手册。
  • 纳入研究评估的指南数量范围为4至86部,报告的GRADE依从性在各研究间差异很大,但10个条目中5个的中位依从率不理想。

关键数值与推荐

  • 归纳出10个可清晰区分的条目用于定义对GRADE的良好依从。
  • 最常涉及的条目为证据确定性评价标准和推荐制定标准(8篇中7篇)。
  • 问题构建与结局选择及重要性评级条目较少见(8篇中3篇)。
  • 8篇提出标准的文献中4篇未报告制定方法和应答选项,均未进行用户测试或提供指导手册。
  • 纳入研究评估的指南数量范围为4至86部。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: Many clinical practice guidelines (CPGs) claim to follow the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach, yet their actual adherence remains uncertain. We aimed to identify and evaluate existing criteria for evaluating adherence to GRADE in CPGs and describe the extent of adherence revealed by their application. STUDY DESIGN AND SETTING: We systematically searched PubMed, Embase, Web of Science, and the Cochrane Library from January 2004 to November 2024, supplemented by manual reviews of the GRADE handbook and related websites. Eligible documents were those that either proposed or applied criteria for evaluating GRADE adherence. We summarized the criteria offered, evaluated the extent to which they meet standards for a structured instrument, and analyzed adherence findings. RESULTS: We identified 11 eligible documents: eight proposed evaluation criteria (four applying their own to evaluate CPGs) and three applied existing criteria. From these criteria, we derived 10 clearly discrete items that can be used to define good adherence to GRADE. The most common items addressed the criteria for assessing certainty of evidence (CoE) and criteria for making recommendations (seven of eight documents), while question framing and outcome selection and importance rating were less frequent (3/8). Among the eight documents proposing criteria, four failed to report their development methods and response options; furthermore, none conducted user testing or provided guidance manuals. The number of CPGs assessed in the included studies ranged from 4 to 86. Reported adherence to GRADE varied considerably across these studies; nevertheless, the median adherence rates were suboptimal for five of the 10 items. CONCLUSION: Existing criteria for assessing GRADE adherence are varied and suboptimal in usability. Evaluations based on these criteria reveal significant application gaps in key areas among CPGs that claim to use GRADE. These findings highlight the need to develop a structured, user-tested evaluation instrument and improve the implementation of GRADE in CPGs. PLAIN LANGUAGE SUMMARY: Many medical guidelines say that they use a trusted scientific method called GRADE to make their advice reliable. But we neither know if they actually follow it correctly nor were there good tools to check. We wanted to find out: 1) what checklists exist to audit GRADE use? and 2) what do those checklists tell us about how well guidelines really apply GRADE? We searched scientific databases and official GRADE sources for studies that either created or used checklists to evaluate GRADE in guidelines. We reviewed these checklists, checked their quality, and summarized what they found when applied. We found 11 relevant studies. The checklists they proposed were inconsistent and poorly designed; none were tested with real users or came with instructions. When used, they showed that many guidelines fail to properly apply key steps of the GRADE method, even though they claim to use it. For half of the important steps, less than 50% of guidelines followed them correctly. This means that current tools for checking GRADE use are unreliable, and many guidelines may not be as trustworthy as they claim. To protect patients and improve medical advice, we urgently need a better, user-friendly audit tool and more support to help guideline developers apply the GRADE method correctly.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Yan S, Guyatt GH, Ren X, et al. Evaluation of grading of recommendations assessment, development, and evaluation approach adherence in clinical practice guidelines: a systematic survey of criteria and their applications. J Clin Epidemiol. 2026. PMID: 41722827. doi:10.1016/j.jclinepi.2026.112186

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。