美容手术风险预测的未来展望:人工智能是否可靠?
本研究评估并比较了ChatGPT-4、Gemini和Copilot 3个大语言模型与美国整形外科医师学会(ASPS)提供的14种常见美容手术知情同意书在可读性、清晰度和医学知识准确性方面的表现,并调查了外科医生的偏好。结果显示,综合一般和具体手术同意书的风险部分医学知识准确性最高(P < .05),而手术特异性知情同意书(包括大语言模型)可读性和清晰度得分最高(P < .05),但医学知识准确性得分最低(P < .05)。外科医生更偏好ChatGPT-4生成的患者材料,认为其准确性和医学信息优于其他AI工具。
要点
- 综合一般和具体手术同意书的风险部分医学知识准确性最高(P < .05)。
- 手术特异性知情同意书(包括大语言模型)可读性和清晰度得分最高(P < .05),但医学知识准确性得分最低(P < .05)。
- 外科医生更偏好ChatGPT-4生成的患者材料,认为其准确性和医学信息优于其他AI工具。
核心结论
- 医生更偏好ChatGPT-4生成的患者材料,因其医学知识精确且全面。
- 遵循ASPS关于签署手术特异性和一般知情同意书的强烈推荐,可避免未来潜在的并发症和伦理问题,确保患者获得充分信息。
研究设计与样本
- 系统评估3个领先的大语言模型(ChatGPT-4、Gemini、Copilot)对14种常见美容手术风险的14个提示的效能、可读性和准确性。
- 同时审查ASPS提供的这些手术知情同意书中的风险部分。
主要发现
- 综合一般和具体手术同意书的风险部分医学知识准确性评分最高(P < .05)。
- 手术特异性知情同意书(包括大语言模型)可读性和清晰度评分最高(P < .05),但医学知识准确性评分最低(P < .05)。
- 外科医生更偏好ChatGPT-4生成的患者材料,认为其准确性和医学信息优于其他AI工具。
关键数值与推荐
- 综合一般和具体手术同意书的风险部分医学知识准确性最高(P < .05)。
- 手术特异性知情同意书(包括大语言模型)可读性和清晰度得分最高(P < .05),但医学知识准确性得分最低(P < .05)。
临床怎么用
- 遵循ASPS的强烈推荐,签署手术特异性和一般知情同意书,以避免未来潜在的并发症和伦理问题,确保患者获得充分信息。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Artificial intelligence (AI) techniques are showing significant potential in the medical field. The rapid advancement in artificial intelligence methods suggests their soon-to-be essential role in physicians' practices. OBJECTIVES: In this study, we sought to assess and compare the readability, clarity, and precision of medical knowledge responses provided by 3 large language models (LLMs) and informed consent forms for 14 common aesthetic surgical procedures, as prepared by the American Society of Plastic Surgeons (ASPS). METHODS: The efficacy, readability, and accuracy of 3 leading LLMs, ChatGPT-4 (OpenAI, San Francisco, CA), Gemini (Google, Mountain View, CA), and Copilot (Microsoft, Redmond, WA), was systematically evaluated with 14 different prompts related to the risks of 14 common aesthetic procedures. Alongside these LLM responses, risk sections from the informed consent forms for these procedures, provided by the ASPS, were also reviewed. RESULTS: The risk factor segments of the combined general and specific operation consent forms were rated highest for medical knowledge accuracy (P < .05). Regarding readability and clarity, the procedure-specific informed consent forms, including LLMs, scored highest scores (P < .05). However, these same forms received the lowest score for medical knowledge accuracy (P < .05). Interestingly, surgeons preferred patient-facing materials created by ChatGPT-4, citing superior accuracy and medical information compared to other AI tools. CONCLUSIONS: Physicians prefer patient-facing materials created by ChatGPT-4 over other AI tools due to their precise and comprehensive medical knowledge. Importantly, adherence to the strong recommendation of ASPS for signing both the procedure-specific and the general informed consent forms can avoid potential future complications and ethical concerns, thereby ensuring patients receive adequate information.
引用
- Duran A, Cortuk O, Ok B, et al. Future Perspective of Risk Prediction in Aesthetic Surgery: Is Artificial Intelligence Reliable? Aesthet Surg J. 2024. PMID: 38941487. doi:10.1093/asj/sjae140
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。