重新评估衰弱临床风险分析指数(RAI)的预测性能
本研究基于美国退伍军人健康管理局(VHA)和匹兹堡大学医学中心(UPMC)的门诊手术患者回顾性队列,评估衰弱风险分析指数(RAI)是否因算法漂移而需要更新评分系统。结果显示现有RAI-C评分系统在预测180天全因死亡率方面仍具有强区分度(UPMC c=0.868,VHA c=0.827),重新校准参数权重仅带来微小改善,且重新分类一名额外衰弱患者需筛查1400-6000人,因此不支持更新评分系统。
要点
- 现有RAI-C评分系统在预测术后180天死亡率方面仍保持强区分度。
- 重新校准参数权重仅带来微小区分度改善,校准改善也有限。
- 重新分类一名额外衰弱患者需筛查1400-6000人,成本效益低。
核心结论
- RAI评分系统在广泛使用十年后仍保持稳健,无证据表明存在有意义的算法漂移。
- 重新校准带来的微小增量改善不足以证明传播和实施修订评分系统所需资源的合理性。
研究设计与样本
- 回顾性队列研究,纳入在VHA或UPMC门诊手术诊所接受评估的患者。
- 使用RAI-临床问卷(RAI-C)评估衰弱,并测量评估后180天全因死亡率。
- 样本包括UPMC的410,715名患者和VHA的190,044名患者。
主要发现
- 现有RAI-C评分系统在UPMC的区分度c=0.868(95%CI 0.864-0.872),在VHA为0.827(95%CI 0.822-0.832)。
- 重新校准参数权重后,UPMC的c=0.872(95%CI 0.868-0.876),VHA为0.839(95%CI 0.834-0.845)。
- 校准在极端值处略有改善(模型倾向于低估死亡率),但在衰弱阈值附近变化很小。
- 癌症诊断的评分权重存在多重共线性驱动的不稳定性,但癌症仍是总分最大贡献因素。
- 决策曲线分析显示,重新分类一名额外衰弱患者需筛查1400-6000名患者(取决于定义衰弱的阈值评分,并考虑假阳性分类的危害)。
关键数值与推荐
- 现有RAI-C评分系统区分度:UPMC c=0.868(95%CI 0.864-0.872),VHA c=0.827(95%CI 0.822-0.832)。
- 重新校准后区分度:UPMC c=0.872(95%CI 0.868-0.876),VHA c=0.839(95%CI 0.834-0.845)。
- 重新分类一名额外衰弱患者需筛查1400-6000名患者。
临床怎么用
- 现有RAI-C评分系统可继续用于手术衰弱评估,无需因算法漂移而更新评分。
- 临床不应期望通过重新校准RAI-C获得有临床意义的预测改善。
- 在资源有限的情况下,维持现有RAI评分系统是合理选择。
局限性
- 研究为回顾性队列设计,可能受残余混杂影响。
- 样本仅来自VHA和UPMC两个医疗系统,外推性需谨慎。
- 癌症诊断权重存在多重共线性驱动的不稳定性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: To examine whether the Risk Analysis Index (RAI), last calibrated in 2010-2014, requires scoring system changes to remain an effective measure of surgical frailty. SUMMARY BACKGROUND DATA: The RAI is among the most validated and widely used measures of surgical frailty. However, like any clinical prediction model, the RAI's scoring system might be prone to algorithmic drift that could invalidate continued use. METHODS: Retrospective cohort study of patients evaluated in outpatient surgery clinics at Veterans Health Administration (VHA) or University of Pittsburgh Medical Center (UPMC). All-cause mortality was measured 180 days after frailty assessment using the RAI-clinical questionnaire (RAI-C). RESULTS: In 410,715 patients from UPMC and 190,044 patients from VHA, the existing RAI-C scoring system demonstrated strong discrimination (c = 0.868 95% CI [0.864-0.872] for UPMC, 0.827 [0.822-0.832] for VHA) which improved modestly after recalibrating parameter weights (c = 0.872 95% CI [0.868-0.876], for UPMC, 0.839 [0.834-0.845] for VHA). Calibration improved slightly, especially at the extremes where the model tends to underpredict mortality, but little change was observed in the range around the threshold of frailty. Of note, the scoring weights associated with a cancer diagnosis demonstrated some multicollinearity-driven instability, but cancer remained the largest contributor to total score. Decision curve analysis demonstrated that reclassification of just a single additional patient as frail would require screening 1400-6000 patients with the recalibrated system, depending on the threshold score defining frailty, and after accounting for the harms of false-positive classification, weighted proportional to the odds at each threshold probability. CONCLUSIONS: The RAI scoring system remains robust after a decade of widespread use without evidence of meaningful algorithmic drift. The minimal incremental improvement associated with recalibration does not justify the resources required to disseminate and implement a revised scoring system.
引用
- Desai N, Jacobs MA, Tran AL, et al. Re-Evaluating Predictive Performance in the Clinical Risk Analysis Index of Frailty. J Am Geriatr Soc. 2026. PMID: 42902074. doi:10.1111/jgs.70777
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。