临床判断与预后临床预测模型的区分度相似且有时更优:一项系统综述
该系统综述纳入41项观察性研究,比较预后临床预测模型(CPM)与临床判断(CJ)的区分度与校准度;其中39项研究偏倚风险高。CPM与CJ的中位AUC分别为0.73与0.71,在124项区分度指标中46.7%无显著差异、25%支持CPM、28.2%支持CJ,4项比较校准度的研究显示CPM更优。
要点
- 预后CPM与CJ的中位AUC分别为0.73与0.71,区分度相似。
- 124项区分度指标中46.7%无显著差异、25%支持CPM、28.2%支持CJ。
- 仅4项研究比较校准度,均显示预后CPM表现更优。
核心结论
- 在许多情况下,临床判断常表现出与预后CPM相当或更优的区分度,尽管模型在校准度上优于临床判断。
- 比较预后CPM与临床判断表现的研究在报告方面需要大幅改进。
研究设计与样本
- 系统综述,检索PubMed、Medline、Embase和CINAHL中的观察性研究。
- 纳入报告预后CPM与临床判断直接统计比较的合格研究。
- 共纳入41项研究,其中39项偏倚风险高,采用PROBAST工具评估偏倚风险。
主要发现
- 41项研究中39项评估区分度,12项评估校准度。
- 预后CPM的中位AUC为0.73(IQR,0.62-0.81),临床判断的中位AUC为0.71(IQR,0.62-0.81)。
- 29项研究提供124项可用于比较分析的区分度指标,其中58项(46.7%)无显著差异(p>0.05),31项(25%)支持预后CPM,35项(28.2%)支持临床判断。
- 4项研究比较校准度,显示预后CPM表现更优。
局限性
- 41项研究中有39项偏倚风险高。
- 比较预后CPM与临床判断表现的研究在报告方面需要大幅改进。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To systematically review the comparative statistical performance (discrimination and /or calibration) of prognostic clinical prediction models (CPMs) and clinician judgment (CJ). STUDY DESIGN AND SETTING: We conducted a systematic review of observational studies in PubMed, Medline, Embase, and CINAHL. Eligible studies reported direct statistical comparison between prognostic CPMs and CJ. Risk of bias was assessed using the PROBAST tool. RESULTS: We identified 41 studies, most with high risk of bias (39 studies). Of these, 41 studies, 39 examined discrimination and 12 studies assessed calibration. Prognostic CPMs had a median AUC of 0.73 (IQR, 0.62 - 0.81), while CJ had a median AUC of 0.71 (IQR, 0.62 - 0.81). 29 studies provided 124 discrimination metrics useful for comparative analysis. Among these, 58 (46.7%) found no significant difference between prognostic CPMs and CJ (p > 0.05); 31 (25%) favored prognostic CPMs, and 35 (28.2%) favored CJ. Four studies compared calibration, showing better performance on prognostic CPMs. CONCLUSIONS: In many instances CJ frequently demonstrates comparable or superior discrimination compared to prognostic CPMs, although models outperform CJ on calibration. Studies comparing performance of prognostic CPMs and CJ require large improvements in reporting.
引用
- Colunga-Lozano LE, Foroutan F, Rayner D, et al. Clinical judgment shows similar and sometimes superior discrimination compared to prognostic clinical prediction models. A systematic review. J Clin Epidemiol. 2023. PMID: 39492557. doi:10.1016/j.jclinepi.2023.10.016
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。