指南与共识流行病学与生物统计医学教育与科研方法

GRADE指南30:评估模型证据确定性的GRADE方法概述

GRADE Guidelines 30: the GRADE approach to assessing the certainty of modeled evidence-An overview in the context of health decision-making.
指南 / 共识 · J Clin Epidemiol · 2020-09-24

本文介绍GRADE工作组提出的评估模型研究证据确定性(即模型输出相关确定性)的概念性方法,适用于系统评价、卫生技术评估和卫生决策背景。该方法认为原有GRADE确定性域同样适用于模型证据,评估取决于模型输入与模型本身性质及评估单一或多个模型,并提出选择最佳可用模型证据的框架。

要点

  • GRADE原有确定性域(偏倚风险、间接性、不一致性、不精确性、报告偏倚、效应量、剂量反应、残余混杂方向)也适用于模型证据评估。
  • 模型证据确定性评估取决于模型输入和模型本身的性质,以及评估的是单一模型还是多个模型。
  • 提出选择最佳可用模型证据的框架:新开发模型、识别现有模型(现成或适配后)、使用多个模型输出。

核心结论

  • 该概念性GRADE方法为在卫生决策中使用模型证据及评估单一或多个模型证据的确定性提供了框架。
  • GRADE工作组与建模社区正在制定评估各确定性域的具体方法和相关指导。

研究设计与样本

  • 通过专家咨询和国际多学科研讨会形成评估模型证据确定性的概念性方法。
  • 讨论澄清了GRADE方法和建模社区使用的选定概念与术语,并收集广泛学科专家反馈以评估内容效度。

主要发现

  • 研讨会参与者一致认为,GRADE方法先前确定的确定性决定域也适用于评估模型证据的确定性。
  • 模型证据确定性评估取决于模型输入和模型本身的性质,以及评估的是单一模型还是多个模型。
  • 提出选择最佳可用模型证据的框架:新开发模型、识别现有模型(现成或适配后)、使用多个模型输出。
  • 提供了首选术语摘要以促进建模与卫生保健学科间的沟通。

关键数值与推荐

  • 确定性决定域包括偏倚风险、间接性、不一致性、不精确性、报告偏倚、效应量、剂量反应关系和残余混杂方向。
  • 选择最佳可用模型证据的框架包括:新开发模型、识别现有模型(现成或适配后)、使用多个模型输出。

临床怎么用

  • 在系统评价、卫生技术评估和卫生决策中,可应用该GRADE框架评估模型证据的确定性。
  • 可根据情境选择新开发模型、现有模型(现成或适配后)或多个模型输出作为最佳可用证据。
  • 使用统一术语促进建模者与卫生决策者之间的沟通。

局限性

  • 目前仅为概念性方法,各确定性域的具体评估方法和相关指导仍在制定中。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: The objective of the study is to present the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) conceptual approach to the assessment of certainty of evidence from modeling studies (i.e., certainty associated with model outputs). STUDY DESIGN AND SETTING: Expert consultations and an international multidisciplinary workshop informed development of a conceptual approach to assessing the certainty of evidence from models within the context of systematic reviews, health technology assessments, and health care decisions. The discussions also clarified selected concepts and terminology used in the GRADE approach and by the modeling community. Feedback from experts in a broad range of modeling and health care disciplines addressed the content validity of the approach. RESULTS: Workshop participants agreed that the domains determining the certainty of evidence previously identified in the GRADE approach (risk of bias, indirectness, inconsistency, imprecision, reporting bias, magnitude of an effect, dose-response relation, and the direction of residual confounding) also apply when assessing the certainty of evidence from models. The assessment depends on the nature of model inputs and the model itself and on whether one is evaluating evidence from a single model or multiple models. We propose a framework for selecting the best available evidence from models: 1) developing de novo, a model specific to the situation of interest, 2) identifying an existing model, the outputs of which provide the highest certainty evidence for the situation of interest, either "off-the-shelf" or after adaptation, and 3) using outputs from multiple models. We also present a summary of preferred terminology to facilitate communication among modeling and health care disciplines. CONCLUSION: This conceptual GRADE approach provides a framework for using evidence from models in health decision-making and the assessment of certainty of evidence from a model or models. The GRADE Working Group and the modeling community are currently developing the detailed methods and related guidance for assessing specific domains determining the certainty of evidence from models across health care-related disciplines (e.g., therapeutic decision-making, toxicology, environmental health, and health economics).

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Brozek JL, Canelo-Aybar C, Akl EA, et al. GRADE Guidelines 30: the GRADE approach to assessing the certainty of modeled evidence-An overview in the context of health decision-making. J Clin Epidemiol. 2020. PMID: 32980429. doi:10.1016/j.jclinepi.2020.09.018

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。