GRADE 指导 37:在测试准确性证据体中评定不精确性
本文为 GRADE 系列指导文件第 37 篇,针对单一测试准确性证据体中不精确性的评级提供方法学指导。GRADE 工作组通过迭代讨论与会议报告形成建议:在评定不精确性前,应先设定判断阈值以界定非常准确、准确、不准确和非常不准确的测试;主要依据绝对测试准确性结果的置信区间是否跨越预设阈值来决定是否降级,当置信区间未跨越阈值时,可考虑纳入研究的合并样本量是否达到所需的最优或综述信息量(OIS/RIS)。
要点
- 评定不精确性前,GRADE 使用者应设定判断阈值,界定非常准确、准确、不准确和非常不准确的测试。
- 主要标准:当绝对测试准确性结果的置信区间明显跨越预设判断阈值时,应考虑降一级或多级。
- 置信区间未跨越阈值时,可考虑合并样本量是否小于所需的最优或综述信息量(OIS/RIS)。
核心结论
- 本文扩展了既往 GRADE 关于单一测试准确性系统评价与指南中不精确性评级的指导,聚焦于应考虑因不精确性降一级或多级的情形。
研究设计与样本
- GRADE 工作组内部项目组通过迭代讨论和在工作组会议上进行报告,形成本指导文件。
主要发现
- GRADE 建议在评定证据确定性前设定判断阈值,界定非常准确、准确、不准确和非常不准确的测试,阈值应在考虑测试后果及对重要结局的影响后设定。
- GRADE 评定测试准确性证据不精确性的主要标准是考虑绝对测试准确性结果(队列中真阳性、假阳性、真阴性和假阴性结果)的置信区间(CI 方法)。
- 基于 CI 方法,当置信区间明显跨越预设判断阈值时,应根据跨越阈值的数量考虑将证据确定性降一级或多级。
- 当置信区间未跨越判断阈值时,GRADE 建议在评定不精确性时考虑足够功效的测试准确性综述的样本量(最优信息量或综述信息量 [OIS/RIS])。
- 若纳入综述的研究合并样本量小于所需 OIS/RIS,应考虑因不精确性降一级或多级。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To provide guidance on rating imprecision in a body of evidence assessing the accuracy of a single test. This guide will clarify when Grading of Recommendations Assessment, Development and Evaluation (GRADE) users should consider rating down the certainty of evidence by one or more levels for imprecision in test accuracy. STUDY DESIGN AND SETTING: A project group within the GRADE working group conducted iterative discussions and presentations at GRADE working group meetings to produce this guidance. RESULTS: Before rating the certainty of evidence, GRADE users should define the target of their certainty rating. GRADE recommends setting judgment thresholds defining what they consider a very accurate, accurate, inaccurate, and very inaccurate test. These thresholds should be set after considering consequences of testing and effects on people-important outcomes. GRADE's primary criterion for judging imprecision in test accuracy evidence is considering confidence intervals (i.e., CI approach) of absolute test accuracy results (true and false, positive, and negative results in a cohort of people). Based on the CI approach, when a CI appreciably crosses the predefined judgment threshold(s), one should consider rating down certainty of evidence by one or more levels, depending on the number of thresholds crossed. When the CI does not cross judgment threshold(s), GRADE suggests considering the sample size for an adequately powered test accuracy review (optimal or review information size [optimal information size (OIS)/review information size (RIS)]) in rating imprecision. If the combined sample size of the included studies in the review is smaller than the required OIS/RIS, one should consider rating down by one or more levels for imprecision. CONCLUSION: This paper extends previous GRADE guidance for rating imprecision in single test accuracy systematic reviews and guidelines, with a focus on the circumstances in which one should consider rating down one or more levels for imprecision.
引用
- Mustafa RA, El Mikati IK, Murad MH, et al. GRADE guidance 37: rating imprecision in a body of evidence on test accuracy. J Clin Epidemiol. 2023. PMID: 38613246. doi:10.1016/j.jclinepi.2023.10.005
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。