文献速递技术与安全MR

人工智能预测分析在门诊MRI预约失约管理中的应用

Artificial Intelligence Predictive Analytics in the Management of Outpatient MRI Appointment No-Shows.
PubMed 文献 · AJR Am J Roentgenol · 2020-09-09

本质量改进项目利用2016至2018年32,957条门诊MRI预约记录及2019年1月1,080条保留测试集训练XGBoost预测模型,总体失约率为17.4%;模型ROC AUC为0.746,保留测试集AUC为0.738;对预测失约风险最高25%的患者实施电话提醒6个月后,失约率从干预前12个月的19.3%降至15.9%(p < 0.0001)。

要点

  • 门诊MRI预约失约率较高,总体为17.4%。
  • XGBoost模型预测失约的ROC AUC为0.746,保留测试集AUC为0.738。
  • 对预测高风险患者电话提醒后失约率由19.3%降至15.9%(p < 0.0001)。

诊断标准与关键数值

  • 预测模型ROC AUC为0.746,优化F1分数为0.708,该阈值下精确率和召回率分别为0.606和0.852。
  • 保留测试集AUC为0.738,优化F1分数为0.721,该阈值下精确率和召回率分别为0.605和0.893。
  • 模型预测失约风险最高25%的患者接受电话呼叫提醒干预。
  • 部署预测模型6个月后失约率为15.9%,干预前12个月为19.3%,较基线失约率改善17.2%(p < 0.0001)。
  • 模型预测高风险组中可联系患者失约率为17.5%,不可联系患者为40.3%(p < 0.0001)。

临床应用与阅片要点

  • 作者将XGBoost预测模型用于识别失约高风险患者并对风险最高25%者进行电话提醒,该项目在6个月内使失约率从19.3%降至15.9%。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVE. Outpatient appointment no-shows are a common problem. Artificial intelligence predictive analytics can potentially facilitate targeted interventions to improve efficiency. We describe a quality improvement project that uses machine learning techniques to predict and reduce outpatient MRI appointment no-shows. MATERIALS AND METHODS. Anonymized records from 32,957 outpatient MRI appointments between 2016 and 2018 were acquired for model training and validation along with a holdout test set of 1080 records from January 2019. The overall no-show rate was 17.4%. A predictive model developed with XGBoost, a decision tree-based ensemble machine learning algorithm that uses a gradient boosting framework, was deployed after various machine learning algorithms were evaluated. The simple intervention measure of using telephone call reminders for patients with the top 25% highest risk of an appointment no-show as predicted by the model was implemented over 6 months. RESULTS. The ROC AUC for the predictive model was 0.746 with an optimized F1 score of 0.708; at this threshold, the precision and recall were 0.606 and 0.852, respectively. The AUC for the holdout test set was 0.738 with an optimized F1 score of 0.721; at this threshold, the precision and recall were 0.605 and 0.893, respectively. The no-show rate 6 months after deployment of the predictive model was 15.9% compared with 19.3% in the preceding 12-month preintervention period, corresponding to a 17.2% improvement from the baseline no-show rate (p < 0.0001). The no-show rates of contactable and noncontactable patients in the group at high risk of appointment no-shows as predicted by the model were 17.5% and 40.3%, respectively (p < 0.0001). CONCLUSION. Machine learning predictive analytics perform moderately well in predicting complex problems involving human behavior using a modest amount of data with basic feature engineering, and they can be incorporated into routine workflow to improve health care delivery.

来源:AJR Am J Roentgenol,查看原文。版权归原作者所有。

引用

  1. Chong LR, Tsai KT, Lee LL, et al. Artificial Intelligence Predictive Analytics in the Management of Outpatient MRI Appointment No-Shows. AJR Am J Roentgenol. 2020. PMID: 32901567. doi:10.2214/AJR.19.22594

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。