文献速递衰弱、肌少症与跌倒

基于大语言模型从临床笔记中识别老年人术前衰弱

A Large Language Model Approach to Identifying Preoperative Frailty Among Older Adults From Clinical Notes.
PubMed 文献 · J Am Geriatr Soc · 2025-05-15

本研究开发并验证了基于大语言模型的二分类器,利用麻醉术前门诊笔记识别老年人术前衰弱。训练集分别以VES-13量表或电子衰弱指数(eFI)定义衰弱。在VES-13验证集上RoBERTa的AUC为0.99,BERT、BioBERT、PubMedBERT分别为0.64、0.67、0.73;在eFI验证集上分别为0.63、0.83、0.87、0.87。

要点

  • 大语言模型可从麻醉术前笔记中识别术前衰弱风险。
  • VES-13训练集上RoBERTa的AUC达0.99,但其他模型差异大。
  • eFI训练集模型在VES-13验证集上区分能力不足。

核心结论

  • 大语言模型分类器可基于麻醉术前临床笔记识别老年人术前衰弱风险。

研究设计与样本

  • 研究训练多种大语言模型从麻醉术前门诊笔记中识别衰弱,使用两个开发数据集:脊柱手术患者以VES-13患者应答定义衰弱,手术患者以计算eFI评分定义衰弱。

主要发现

  • 在VES-13训练集训练并在VES-13验证集测试时,RoBERTa、BERT、BioBERT、PubMedBERT的AUC分别为0.99、0.64、0.67、0.73。
  • 在eFI验证集测试时,上述四个模型的AUC分别为0.63、0.83、0.87、0.87。
  • 以eFI开发数据集训练的模型在VES-13验证集上未能充分区分衰弱。

关键数值与推荐

  • 衰弱定义采用VES-13患者应答或计算eFI评分,模型性能以AUC评价。

临床怎么用

  • 可利用麻醉术前临床笔记中的非结构化信息,辅助识别老年人术前衰弱风险。

局限性

  • 以eFI训练集开发的模型在VES-13验证集上区分能力不足,提示模型跨衰弱定义泛化有限。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Patients with frailty have a higher risk of major postoperative mortality and morbidity. Identifying frailty from the medical record, however, is not straightforward since it is a multifactorial state based on multiple organ systems and a sum of factors accumulated over time. The objective of this study was to develop a large language model-based binary classifier using accurately phenotyped datasets to identify preoperative frailty from clinical notes. METHODS: We trained various large language models to identify frailty from anesthesia preoperative clinic notes. There were two development datasets used: (1) patients undergoing spine surgery whose frailty was characterized by patient responses to the Vulnerable Elders-13 Survey (VES-13); and (2) patients undergoing surgery whose frailty was characterized by their calculated electronic frailty index (eFI) score. RESULTS: When trained on our VES-13 development set and tested on our VES-13 validation set, the area under the receiver operating characteristics curve (AUC) for the RoBERTa, BERT, BioBERT, and PubMedBERT models was 0.99, 0.64, 0.67, and 0.73, respectively. When tested on the eFI validation set, the AUCs were 0.63, 0.83, 0.87, and 0.87, respectively. Models trained on the eFI development dataset did not discriminate frailty adequately when tested on the VES-13 validation set. CONCLUSION: We report the development and validation of a classifier that detects older adults at risk for preoperative frailty from preoperative anesthesia clinical notes. Large language models can be used to accurately identify a difficult-to-quantify and multifactorial characteristic such as frailty in patients by using readily available unstructured information from clinical notes.

来源:J Am Geriatr Soc,查看原文。版权归原作者所有。

引用

  1. Zhou YQ, Litake O, Meineke MN, et al. A Large Language Model Approach to Identifying Preoperative Frailty Among Older Adults From Clinical Notes. J Am Geriatr Soc. 2025. PMID: 40372061. doi:10.1111/jgs.19545

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。