预测头颈癌患者急诊就诊与非计划住院的机器学习算法的开发与验证
基于加拿大安大略省2007年1月至2018年3月诊断的头颈癌患者人群,开发并验证机器学习模型预测症状评估后14天内急诊就诊或非计划住院(ED/Hosp)。梯度提升机验证集AUROC为0.80(95%CI 0.78-0.81),仅用症状严重度数据的模型AUROC为0.72(95%CI 0.70-0.74),患者报告症状评分始终是最具预测力的特征。
要点
- 梯度提升机模型预测14天ED/Hosp的验证AUROC为0.80(95%CI 0.78-0.81)。
- 仅用症状严重度数据的模型AUROC为0.72(95%CI 0.70-0.74)。
- 患者报告症状评分在各模型中始终是最具预测力的特征。
核心结论
- 机器学习方法能高精度预测头颈癌患者的ED/Hosp,可用于风险分层并可能帮助指导靶向干预。
研究设计与样本
- 基于人群的预测建模研究,纳入加拿大安大略省2007年1月至2018年3月诊断的头颈癌患者。
- 训练队列9409例(平均[SD]年龄63.3[10.9]岁),共59089次症状评估(80%)。
- 测试队列2352例(平均[SD]年龄63.3[11]岁),共14193次症状评估(20%),训练与测试按4:1随机生成。
- 探索的算法包括LASSO逻辑回归、随机森林、梯度提升机、k近邻和人工神经网络。
- 数据分析时间为2021年9月至2022年1月。
主要发现
- 梯度提升机验证AUROC为0.80(95%CI 0.78-0.81)。
- 基于Youden指数的截断点对应验证灵敏度0.77、特异度0.66。
- 仅用症状严重度数据构建的第二模型AUROC为0.72(95%CI 0.70-0.74)。
- 患者报告症状评分在模型中被一致识别为最具预测力的特征。
关键数值与推荐
- 主要结局为症状评估后任何14天内的ED/Hosp事件。
- 模型性能在测试队列上用AUROC曲线和校准图评估,并用Shapley值识别贡献最大的变量。
临床怎么用
- 原文结论指出这些工具可用于准确风险分层患者,并可能帮助指导靶向干预。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
IMPORTANCE: Patient-reported symptom burden was recently found to be associated with emergency department use and unplanned hospitalization (ED/Hosp) in patients with head and neck cancer. It was hypothesized that symptom scores could be combined with administrative health data to accurately risk stratify patients. OBJECTIVE: To develop and validate a machine learning approach to predict future ED/Hosp in patients with head and neck cancer. DESIGN, SETTING, AND PARTICIPANTS: This was a population-based predictive modeling study of patients in Ontario, Canada, diagnosed with head and neck cancer from January 2007 through March 2018. All outpatient clinical encounters were identified. Edmonton Symptom Assessment System (ESAS) scores and clinical and demographic factors were abstracted. Training and test cohorts were randomly generated in a 4:1 ratio. Various machine learning algorithms were explored, including (1) logistic regression using a least absolute shrinkage and selection operator, (2) random forest, (3) gradient boosting machine, (4) k-nearest neighbors, and (5) an artificial neural network. Data analysis was performed from September 2021 to January 2022. MAIN OUTCOMES AND MEASURES: The main outcome was any 14-day ED/Hosp event following symptom assessment. The performance of each model was assessed on the test cohort using the area under the receiver operator characteristic (AUROC) curve and calibration plots. Shapley values were used to identify the variables with greatest contribution to the model. RESULTS: The training cohort consisted of 9409 patients (mean [SD] age, 63.3 [10.9] years) undergoing 59 089 symptom assessments (80%). The remaining 2352 patients (mean [SD] age, 63.3 [11] years) and 14 193 symptom assessments were set aside as the test cohort (20%). Several models had high predictive accuracy, particularly the gradient boosting machine (validation AUROC, 0.80 [95% CI, 0.78-0.81]). A Youden-based cutoff corresponded to a validation sensitivity of 0.77 and specificity of 0.66. Patient-reported symptom scores were consistently identified as being the most predictive features within models. A second model built only with symptom severity data had an AUROC of 0.72 (95% CI, 0.70-0.74). CONCLUSIONS AND RELEVANCE: In this study, machine learning approaches predicted with a high degree of accuracy ED/Hosp in patients with head and neck cancer. These tools could be used to accurately risk stratify patients and may help direct targeted intervention.
引用
- Noel CW, Sutradhar R, Gotlib Conn L, et al. Development and Validation of a Machine Learning Algorithm Predicting Emergency Department Use and Unplanned Hospitalization in Patients With Head and Neck Cancer. JAMA Otolaryngol Head Neck Surg. 2022. PMID: 35771564. doi:10.1001/jamaoto.2022.1629
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。