文献速递创伤骨科骨质疏松与代谢性骨病

SORG骨科研究组髋部骨折谵妄算法在独立洲际60岁及以上髋部骨折患者队列中的表现是否良好?

Does the SORG Orthopaedic Research Group Hip Fracture Delirium Algorithm Perform Well on an Independent Intercontinental Cohort of Patients With Hip Fractures Who Are 60 Years or Older?
PubMed 文献 · Clin Orthop Relat Res · 2022-05-10

本研究在澳大利亚和新西兰髋部骨折登记处的6270例60岁以上手术患者中外部验证SORG髋部骨折术后谵妄机器学习算法,该队列术后谵妄发生率为39%(2467/6270)。算法区分度c-statistic为0.74(95%CI 0.73-0.76),校准图在较低预测概率时表现准确(截距-0.28,斜率0.52),Brier评分0.22(零模型Brier评分0.24)。结论认为当前版本SORG算法不应依赖用于患者照护,但提示在风险评估方面有潜在效用。

要点

  • SORG髋部骨折谵妄算法在澳新外部队列的c-statistic为0.74(95%CI 0.73-0.76)。
  • 校准图截距-0.28、斜率0.52,Brier评分0.22(零模型0.24)。
  • 当前版本SORG算法不应依赖用于患者照护,但提示风险评估有潜在效用。

核心结论

  • 机器学习开发的算法是优化高危患者治疗的潜在工具。
  • 若能可靠识别高危患者,可将资源适当导向其照护。
  • 当前版本SORG算法不应依赖用于患者照护,但提示在评估风险方面有潜在效用。
  • 在不同人群中进一步评估将有助于开发普遍有效的预测模型。

研究设计与样本

  • 回顾性分析,使用2017年6月至2018年12月澳大利亚和新西兰髋部骨折登记处60岁以上因股骨颈、股骨转子间或股骨转子下骨折手术的患者记录。
  • 初始模型基于美国外科医师学会国家手术质量改进计划28207例髋部骨折患者记录于2021年开发,纳入年龄、ASA分级、功能状态、术前痴呆、术前谵妄和术前助行器需求。
  • 6672例患者中6%(402/6672)不符合纳入标准,94%(6270/6672)纳入分析;采用missForest方法插补缺失数据。
  • 排除病理学髋部骨折或感染性休克患者。
  • 证据等级III级,治疗性研究。

主要发现

  • 总队列39%(2467/6270)患者发生术后谵妄。
  • 算法区分度c-statistic为0.74(95%CI 0.73-0.76)。
  • 校准图在较低预测概率时显示高准确性(截距-0.28,斜率0.52)。
  • Brier评分为0.22,零模型Brier评分为0.24。
  • 决策曲线分析显示该模型相比无模型或将所有患者视为有谵妄风险可带来获益。

关键数值与推荐

  • 队列年龄分布:71%(4249/5986)患者年龄80岁及以上(缺失值5%,284/6270)。
  • 性别分布:68%(4292/6266)为女性(缺失值0.06%,4/6270)。
  • ASA分级:83%(4690/5661)患者为ASA III/IV级(缺失值10%,609/6270)。

临床怎么用

  • 当前版本SORG算法不应依赖用于患者照护,但提示在评估风险方面有潜在效用。
  • 模型可免费访问:https://sorg-apps.shinyapps.io/hipfxdelirium/。

局限性

  • 当前版本SORG算法不应依赖用于患者照护。
  • 在不同人群中进一步评估将有助于开发普遍有效的预测模型。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Postoperative delirium in patients aged 60 years or older with hip fractures adversely affects clinical and functional outcomes. The economic cost of delirium is estimated to be as high as USD 25,000 per patient, with a total budgetary impact between USD 6.6 to USD 82.4 billion annually in the United States alone. Forty percent of delirium episodes are preventable, and accurate risk stratification can decrease the incidence and improve clinical outcomes in patients. A previously developed clinical prediction model (the SORG Orthopaedic Research Group hip fracture delirium machine-learning algorithm) is highly accurate on internal validation (in 28,207 patients with hip fractures aged 60 years or older in a US cohort) in identifying at-risk patients, and it can facilitate the best use of preventive interventions; however, it has not been tested in an independent population. For an algorithm to be useful in real life, it must be valid externally, meaning that it must perform well in a patient cohort different from the cohort used to "train" it. With many promising machine-learning prediction models and many promising delirium models, only few have also been externally validated, and even fewer are international validation studies. QUESTION/PURPOSE: Does the SORG hip fracture delirium algorithm, initially trained on a database from the United States, perform well on external validation in patients aged 60 years or older in Australia and New Zealand? METHODS: We previously developed a model in 2021 for assessing risk of delirium in hip fracture patients using records of 28,207 patients obtained from the American College of Surgeons National Surgical Quality Improvement Program. Variables included in the original model included age, American Society of Anesthesiologists (ASA) class, functional status (independent or partially or totally dependent for any activities of daily living), preoperative dementia, preoperative delirium, and preoperative need for a mobility aid. To assess whether this model could be applied elsewhere, we used records from an international hip fracture registry. Between June 2017 and December 2018, 6672 patients older than 60 years of age in Australia and New Zealand were treated surgically for a femoral neck, intertrochanteric hip, or subtrochanteric hip fracture and entered into the Australian & New Zealand Hip Fracture Registry. Patients were excluded if they had a pathological hip fracture or septic shock. Of all patients, 6% (402 of 6672) did not meet the inclusion criteria, leaving 94% (6270 of 6672) of patients available for inclusion in this retrospective analysis. Seventy-one percent (4249 of 5986) of patients were aged 80 years or older, after accounting for 5% (284 of 6270) of missing values; 68% (4292 of 6266) were female, after accounting for 0.06% (4 of 6270) of missing values, and 83% (4690 of 5661) of patients were classified as ASA III/IV, after accounting for 10% (609 of 6270) of missing values. Missing data were imputed using the missForest methodology. In total, 39% (2467 of 6270) of patients developed postoperative delirium. The performance of the SORG hip fracture delirium algorithm on the validation cohort was assessed by discrimination, calibration, Brier score, and a decision curve analysis. Discrimination, known as the area under the receiver operating characteristic curves (c-statistic), measures the model's ability to distinguish patients who achieved the outcomes from those who did not and ranges from 0.5 to 1.0, with 1.0 indicating the highest discrimination score and 0.50 the lowest. Calibration plots the predicted versus the observed probabilities, a perfect plot has an intercept of 0 and a slope of 1. The Brier score calculates a composite of discrimination and calibration, with 0 indicating perfect prediction and 1 the poorest. RESULTS: The SORG hip fracture algorithm, when applied to an external patient cohort, distinguished between patients at low risk and patients at moderate to high risk of developing postoperative delirium. The SORG hip fracture algorithm performed with a c-statistic of 0.74 (95% confidence interval 0.73 to 0.76). The calibration plot showed high accuracy in the lower predicted probabilities (intercept -0.28, slope 0.52) and a Brier score of 0.22 (the null model Brier score was 0.24). The decision curve analysis showed that the model can be beneficial compared with no model or compared with characterizing all patients as at risk for developing delirium. CONCLUSION: Algorithms developed with machine learning are a potential tool for refining treatment of at-risk patients. If high-risk patients can be reliably identified, resources can be appropriately directed toward their care. Although the current iteration of SORG should not be relied on for patient care, it suggests potential utility in assessing risk. Further assessment in different populations, made easier by international collaborations and standardization of registries, would be useful in the development of universally valid prediction models. The model can be freely accessed at: https://sorg-apps.shinyapps.io/hipfxdelirium/ . LEVEL OF EVIDENCE: Level III, therapeutic study.

来源:Clin Orthop Relat Res,查看原文。版权归原作者所有。

引用

  1. Oosterhoff JHF, Oberai T, Karhade AV, et al. Does the SORG Orthopaedic Research Group Hip Fracture Delirium Algorithm Perform Well on an Independent Intercontinental Cohort of Patients With Hip Fractures Who Are 60 Years or Older? Clin Orthop Relat Res. 2022. PMID: 35561268. doi:10.1097/CORR.0000000000002246

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。