文献速递神经肿瘤

多机构自然语言处理模型预测脑膜瘤切除术后出院去向

Predicting Discharge Disposition Following Meningioma Resection Using a Multi-Institutional Natural Language Processing Model.
PubMed 文献 · Neurosurgery · 2021-01-01

本研究基于595例脑膜瘤切除术患者的术前记录和影像报告,训练了32种算法并集成其中3种最佳算法,构建自然语言处理(NLP)模型预测非家庭出院。单机构模型内部验证AUC为0.80(95%CI=0.74-0.86),优于52变量集成模型的0.77(95%CI=0.73-0.81)。纳入另一中心693例患者后,多机构模型内部验证AUC为0.78(95%CI=0.74-0.81),保持良好性能。

要点

  • NLP模型仅用术前记录和影像报告即可预测非家庭出院,性能优于传统52变量模型。
  • 术前记录对预测影响最大,模型已在线提供使用。
  • 多机构模型性能稳定,支持跨中心推广。

核心结论

  • NLP模型能有效预测脑膜瘤切除术后非家庭出院,且多机构训练后性能保持稳定。

研究设计与样本

  • 回顾性收集单中心1995-2015年595例成人脑膜瘤切除术患者的年龄、术前记录和影像报告,训练32种算法并集成最佳3种。
  • 随后纳入另一中心693例患者记录构建多机构模型,以AUC和校准评估预测能力,并与已发表的52变量模型比较。

主要发现

  • 单机构NLP模型预测非家庭出院的内部验证AUC为0.80(95%CI=0.74-0.86),留出验证AUC为0.76。
  • 52变量集成模型的内部验证AUC为0.77(95%CI=0.73-0.81),留出验证AUC为0.74。
  • 多机构NLP模型内部验证AUC为0.78(95%CI=0.74-0.81),留出验证AUC为0.76。
  • 术前记录对模型预测性能影响最大。

临床怎么用

  • 该NLP模型可基于常规术前文本预测非家庭出院,辅助临床早期规划出院去向。
  • 模型已在线提供(http://nlp-home.insds.org),可供临床参考使用。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Machine learning (ML)-based predictive models are increasingly common in neurosurgery, but typically require large databases of discrete variables for training. Natural language processing (NLP) can extract meaningful data from unstructured text. OBJECTIVE: To present an NLP model that predicts nonhome discharge and a point-of-care implementation. METHODS: We retrospectively collected age, preoperative notes, and radiology reports from 595 adults who underwent meningioma resection in an academic center from 1995 to 2015. A total of 32 algorithms were trained with the data; the 3 best performing algorithms were combined to form an ensemble. Predictive ability, assessed by area under the receiver operating characteristic curve (AUC) and calibration, was compared to a previously published model utilizing 52 neurosurgeon-selected variables. We then built a multi-institutional model by incorporating notes from 693 patients at another center into algorithm training. Permutation importance was used to analyze the relative importance of each input to model performance. Word clouds and non-negative matrix factorization were used to analyze predictive features of text. RESULTS: The single-institution NLP model predicted nonhome discharge with AUC of 0.80 (95% CI = 0.74-0.86) on internal and 0.76 on holdout validation compared to AUC of 0.77 (95% CI = 0.73-0.81) and 0.74 for the 52-variable ensemble. The multi-institutional model performed similarly well with AUC = 0.78 (95% CI = 0.74-0.81) on internal and 0.76 on holdout validation. Preoperative notes most influenced predictions. The model is available at http://nlp-home.insds.org. CONCLUSION: ML and NLP are underutilized in neurosurgery. Here, we construct a multi-institutional NLP model that predicts nonhome discharge.

来源:Neurosurgery,查看原文。版权归原作者所有。

引用

  1. Muhlestein WE, Monsour MA, Friedman GN, et al. Predicting Discharge Disposition Following Meningioma Resection Using a Multi-Institutional Natural Language Processing Model. Neurosurgery. 2021. PMID: 33483747. doi:10.1093/neuros/nyaa585

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。