大型语言模型利用初诊前问卷回答预测膝关节和肩关节主诉患者的手术转诊建议,影像检查和手术建议准确率分别为70%和81%
该回顾性横断面研究纳入2020至2023年骨科运动医学门诊新患者1141例,使用零样本提示让预训练大型语言模型分析初诊前问卷回答,预测是否需要先进影像检查和/或手术干预,并与外科医生实际计划比较。模型仅用问卷预测影像推荐的准确率为70%(敏感度83%,特异度64%),结合影像报告后预测手术推荐的准确率为81%(敏感度88%,特异度72%)。
要点
- 模型仅凭初诊前问卷预测影像推荐准确率70%,结合影像报告后手术推荐准确率81%。
- 影像推荐对前交叉韧带(94%)、半月板(85%)和肩袖(80%)损伤准确,对膝(54%)和肩(66%)关节炎较差。
- 手术推荐对前交叉韧带(93%)、肩袖(83%)、半月板(78%)和肩不稳相关病变(78%)高度准确。
核心结论
- 预训练大型语言模型利用新骨科膝关节和肩关节主诉患者的初诊前问卷数据,影像推荐准确率为70%,结合影像报告的手术决策模型准确率为81%。
研究设计与样本
- 回顾性横断面研究,纳入2020至2023年骨科运动医学门诊新患者1141例,使用零样本提示让大型语言模型分析初诊前问卷回答,以外科医生实际计划为参考标准,模型对包括外科笔记、体格检查或转诊数据在内的其他临床信息设盲。
诊断标准与关键数值
- 仅用初诊前问卷预测先进影像推荐:准确率70%,敏感度83%,特异度64%;结合影像报告预测手术推荐:准确率81%,敏感度88%,特异度72%。影像推荐准确率:前交叉韧带94%、半月板85%、肩袖80%、膝关节炎54%、肩关节炎66%;手术推荐准确率:前交叉韧带93%、半月板78%、肩袖83%、肩不稳相关病变78%。
临床应用与阅片要点
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: To validate the performance of a pretrained large language model (LLM) in predicting orthopaedic surgeon recommendations for management of newly referred patients, using free-text previsit questionnaire responses as input.
METHODS: This retrospective cross-sectional study included new patients visiting an orthopaedic sports medicine clinic between 2020 and 2023. Using zero-shot prompting, the LLM analyzed previsit questionnaire responses (e.g., "When did you start to have pain?") to predict whether patients required advanced imaging and/or surgical intervention. The LLM was blinded to all other clinical information, including surgeon notes, physical exams, or referral data. Model predictions were evaluated with accuracy, sensitivity, and specificity in comparison to actual surgeon-generated plans. For a subset of patients who had undergone advanced imaging, the LLM was augmented with free-text radiology reports and asked to provide updated surgical recommendations.
RESULTS: In the combined cohort of 1141 patients, the LLM predicted surgeon recommendation for advanced imaging with 70% accuracy, 83% sensitivity, and 64% specificity using previsit questionnaire responses alone. Imaging predictions were accurate for common diagnoses, including anterior cruciate ligament (ACL, 94%), meniscus (85%), and rotator cuff (80%) injuries but poor for knee (54%) and shoulder arthritis (66%). When augmented with imaging reports, the LLM predicted recommendations for surgery with 81% accuracy, 88% sensitivity, and 72% specificity. Surgical predictions were highly accurate for ACL (93%), meniscus (78%), rotator cuff (83%), and shoulder instability related pathologies (78%).
CONCLUSIONS: Using previsit questionnaire data from new orthopaedic patients with knee and shoulder complaints, the pretrained LLM showed 70% accuracy for imaging recommendations, and the augmented surgical-decision LLM showed 81% accuracy for surgical recommendations.
LEVEL OF EVIDENCE: Level III, retrospective diagnostic case-control study.
引用
- Halvorson RT, Keeley T, Niknam K, et al. Large Language Model Predicts Surgeon Recommendations for Imaging and Surgery for Patients Presenting for Knee and Shoulder Complaints With 70% and 81% Accuracy Using Previsit Questionnaire Responses. Arthroscopy. 2026. PMID: 41838559. doi:10.1002/arj.70016
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。