GRADE概念论文8:在验证研究体系中判断预后模型区分度性能估计的确定性
该概念论文提出在评估预后模型区分度证据确定性时,应设定三个阈值来确定评级目标:模型区分能力优于随机猜测、临床医生直觉分类、同一疾病领域和结局的替代预后模型。阈值选择因情境而异,该方法将观察到的区分度置于有依据的谱系中,而非依赖任意截断值,可能有助于判断模型的实用价值。
要点
- 评级预后模型区分度确定性时,应设定三个阈值之一作为目标。
- 第一阈值评级模型分类能力优于随机猜测的确定性。
- 另两阈值基于临床医生直觉或同一疾病领域和结局的替代模型。
核心结论
- 提出三个阈值用于评级预后模型区分度证据的确定性,阈值选择因情境而异,该方法可能有助于判断模型的实用价值。
研究设计与样本
- 概念论文,提出在验证研究体系中评级预后模型区分度确定性的三个阈值方法。
主要发现
- 第一阈值评级模型分类能力优于随机猜测的确定性。
- 另两个阈值基于临床医生直觉或同一疾病领域和结局的替代预后模型设定。
- 阈值选择因情境而异,方法将观察到的区分度置于有依据的谱系中,而非依赖任意截断值。
关键数值与推荐
- 三个阈值:模型分类优于随机猜测、基于临床医生直觉的分类、基于同一疾病领域和结局的替代预后模型的分类。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Prognostic models incorporate multiple prognostic factors to estimate the likelihood of future events for individual patients based on their prognostic factor values. Evaluating these models crucially involves conducting studies to assess their predictive performance, like discrimination. Systematic reviews and meta-analyses of these validation studies play an essential role in selecting models for clinical practice. METHODS: In this paper, we outline 3 thresholds to determine the target for certainty rating in the discrimination of prognostic models, as observed across a body of validation studies. RESULTS AND CONCLUSION: We propose 3 thresholds when rating the certainty of evidence about a prognostic model's discrimination. The first threshold amounts to rating certainty in the model's ability to classify better than random chance. The other 2 approaches involve setting thresholds informed by other mechanisms for classification: clinician intuition or an alternative prognostic model developed for the same disease area and outcome. The choice of threshold will vary based on the context. Instead of relying on arbitrary discrimination cut-offs, our approach positions the observed discrimination within an informed spectrum, potentially aiding decisions about a prognostic model's practical utility.
引用
- Foroutan F, Mayer M, Guyatt G, et al. GRADE concept paper 8: judging the certainty of discrimination performance estimates of prognostic models in a body of validation studies. J Clin Epidemiol. 2024. PMID: 38579978. doi:10.1016/j.jclinepi.2024.111344
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。