GRADE概念论文2:在验证性研究集合中判断预后模型校准确定性的概念
本文阐述在评估预后模型校准性能的确定性时四个关键概念:推断形式(满意或不满意)、不一致性作为关键GRADE域、不同不一致模式影响确定性评级、以及观察与预期比值点估计的分布及其决定因素对未来研究需求与方向的指导意义。
要点
- 判断预后模型校准确定性时,需先明确评级的是模型性能满意还是不满意。
- 不一致性是决定模型性能满意或不满意确定性的关键GRADE域。
- 不同不一致模式对满意与不满意性能的确定性评级影响不同。
核心结论
- 评估预后模型校准确定性的四个关键概念涉及推断形式、不一致性作为关键GRADE域、不一致模式对评级的影响、以及观察与预期比值分布对未来研究的指导。
研究设计与样本
- 本文为GRADE概念论文,旨在阐述评估预后模型校准确定性时涉及的关键概念。
主要发现
- 推断关于校准可以采取两种形式:评级模型性能满意的确定性,或评级模型性能不满意的确定性,两种情况下均需定义满意(或不满意)模型性能的阈值。
- 不一致性是决定评级模型性能满意或不满意确定性的关键GRADE域。
- 根据评级的是满意还是不满意性能,研究中不同模式的结果不一致性将影响证据确定性的评级。
- 探索个体研究中观察与预期比值点估计的分布及其决定因素,将影响未来研究的必要性和方向。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Prognostic models combine several prognostic factors to provide an estimate of the likelihood (or risk) of future events in individual patients, conditional on their prognostic factor values. A fundamental part of evaluating prognostic models is undertaking studies to determine whether their predictive performance, such as calibration and discrimination, is reproduced across settings. Systematic reviews and meta-analyses of studies evaluating prognostic models' performance are a necessary step for selection of models for clinical practice and for testing the underlying assumption that their use will improve outcomes, including patient's reassurance and optimal future planning. METHODS: In this paper, we highlight key concepts in evaluating the certainty of evidence regarding the calibration of prognostic models. RESULTS AND CONCLUSION: Four concepts are key to evaluating the certainty of evidence on prognostic models' performance regarding calibration. The first concept is that the inference regarding calibration may take one of two forms: deciding whether one is rating certainty that a model's performance is satisfactory or, instead, unsatisfactory, in either case defining the threshold for satisfactory (or unsatisfactory) model performance. Second, inconsistency is the critical GRADE domain to deciding whether we are rating certainty in the model performance being satisfactory or unsatisfactory. Third, depending on whether one is rating certainty in satisfactory or unsatisfactory performance, different patterns of inconsistency of results across studies will inform ratings of certainty of evidence. Fourth, exploring the distribution of point estimates of observed to expected ratio across individual studies, and its determinants, will bear on the need for and direction of future research.
引用
- Foroutan F, Guyatt G, Trivella M, et al. GRADE concept paper 2: Concepts for judging certainty on the calibration of prognostic models in a body of validation studies. J Clin Epidemiol. 2021. PMID: 34800677. doi:10.1016/j.jclinepi.2021.11.024
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。