ChatGPT-4.0生成术前麻醉计划:混合方法研究
本研究通过10个临床案例评估ChatGPT-4.0生成术前麻醉计划的质量、有效性和安全性,并与8位资深麻醉顾问的计划比较。结果显示ChatGPT计划与顾问计划一致性可变,在心肺风险估计上常不一致,且存在重复、缺乏区域麻醉技术、术后疼痛管理建议不佳及未对高误吸风险患者推荐气管插管等不当建议。结论认为ChatGPT目前不推荐用于术前计划。
要点
- ChatGPT生成麻醉计划与顾问计划一致性可变,心肺风险估计常不一致。
- ChatGPT答案重复,偏好全麻,缺乏区域麻醉技术。
- 存在不当建议:术后疼痛管理欠佳,高误吸风险未推荐插管。
核心结论
- ChatGPT生成的术前麻醉计划未持续达到最低临床标准,不太可能源于临床推理,目前不推荐用于术前计划。
研究设计与样本
- 探索性、单中心、收敛混合方法研究,随机选取10个临床案例,由ChatGPT-4.0生成麻醉计划,并与8位资深麻醉顾问的计划比较。
主要发现
- ChatGPT计划与顾问计划一致性可变,心肺风险估计常不一致。
- ChatGPT答案重复且缺乏多样性,强烈偏好全麻,缺乏区域麻醉技术。
- 在气道管理、术后镇痛和药物使用方面选择不一致。
- 术后疼痛管理建议不佳,且未对高误吸风险患者推荐气管插管,被视为不当建议。
关键数值与推荐
- 心肺风险估计的一致性采用加权Kappa计算,其他结局用描述性数据表示。
临床怎么用
- 目前不推荐将ChatGPT用于术前麻醉计划。
- 未来基于麻醉特定数据集训练的大语言模型可能改善性能,但临床使用前需经过严格评估。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Recent advances in artificial intelligence (AI) have enabled development of natural language algorithms capable of generating coherent texts. We evaluated the quality, validity, and safety of this generative AI in preoperative anaesthetic planning. METHODS: In this exploratory, single-centre, convergent mixed-method study, 10 clinical vignettes were randomly selected, and ChatGPT (OpenAI, 4.0) was prompted to create anaesthetic plans, including cardiopulmonary risk assessment, intraoperative anaesthesia technique, and postoperative management. A quantitative assessment compared these plans with those made by eight senior anaesthesia consultants. A qualitative assessment was performed by an adjudication committee through focus group discussion and thematic analysis. Agreement on cardiopulmonary risk assessment was calculated using weighted Kappa, with descriptive data representation for other outcomes. RESULTS: ChatGPT anaesthetic plans showed variable agreement with consultants' plans. ChatGPT, the survey panel, and adjudication committee frequently disagreed on cardiopulmonary risk estimation. The ChatGPT answers were repetitive and lacked variety, evidenced by the strong preference for general anaesthesia and absence of locoregional techniques. It also showed inconsistent choices regarding airway management, postoperative analgesia, and medication use. While some differences were not deemed clinically significant, subpar postoperative pain management advice and failure to recommend tracheal intubation for patients at high risk for pulmonary aspiration were considered inappropriate recommendations. CONCLUSIONS: Preoperative anaesthetic plans generated by ChatGPT did not consistently meet minimum clinical standards and were unlikely the result of clinical reasoning. Therefore, ChatGPT is currently not recommended for preoperative planning. Future large language models trained on anaesthesia-specific datasets might improve performance but should undergo vigorous evaluation before use in clinical practice.
引用
- Abdel Malek M, van Velzen M, Dahan A, et al. Generation of preoperative anaesthetic plans by ChatGPT-4.0: a mixed-method study. Br J Anaesth. 2024. PMID: 39547871. doi:10.1016/j.bja.2024.08.038
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。