比较ChatGPT与外科医生对患者甲状腺相关问题的回答
这项横断面研究从华医通应用获取28个甲状腺相关问题,加2个干扰问题共30题,由ChatGPT(GPT-4.0)、初级和高级专科医生分别回答,26例患者和11名甲状腺外科医生从准确性、全面性、同理心和满意度4个维度评估。ChatGPT回答速度快于初级和高级专科医生,字数更多,4个维度得分均更高,但需进一步研究验证其处理复杂甲状腺问题的逻辑能力。
要点
- ChatGPT回答速度8.69[7.53-9.48]快于初级4.33[4.05-4.60]和高级4.22[3.36-4.76]专科医生(均P<.001)。
- ChatGPT回答字数341.50[301.00-384.25]多于初级74.50[51.75-84.75]和高级104.00[63.75-177.75](均P<.001)。
- ChatGPT在准确性、全面性、同理心和满意度4个维度得分均高于初级和高级专科医生。
核心结论
- ChatGPT在回答常见甲状腺相关问题方面表现优于初级和高级专科医生,但需进一步研究验证其处理复杂甲状腺问题的逻辑能力。
研究设计与样本
- 横断面研究,从华医通应用获取28个甲状腺相关问题,加2个干扰问题共30题,由ChatGPT(GPT-4.0)、1名初级专科医生和1名高级专科医生分别回答(ChatGPT于2023年7月19日、医生于2023年7月20日)。
- 由26例患者和11名甲状腺外科医生对回答进行评分。
主要发现
- ChatGPT回答速度8.69[7.53-9.48]快于初级专科医生4.33[4.05-4.60](P<.001)和高级专科医生4.22[3.36-4.76](P<.001)。
- ChatGPT回答字数341.50[301.00-384.25]多于初级专科医生74.50[51.75-84.75](P<.001)和高级专科医生104.00[63.75-177.75](P<.001)。
- ChatGPT在准确性、全面性、同理心和满意度4个维度得分均高于初级和高级专科医生。
临床怎么用
- 原文未据此给出推荐。
局限性
- 需进一步研究验证ChatGPT处理复杂甲状腺问题的逻辑能力。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
CONTEXT: For some common thyroid-related conditions with high prevalence and long follow-up times, ChatGPT can be used to respond to common thyroid-related questions. OBJECTIVE: In this cross-sectional study, we assessed the ability of ChatGPT (version GPT-4.0) to provide accurate, comprehensive, compassionate, and satisfactory responses to common thyroid-related questions. METHODS: First, we obtained 28 thyroid-related questions from the Huayitong app, which together with the 2 interfering questions eventually formed 30 questions. Then, these questions were responded to by ChatGPT (on July 19, 2023), a junior specialist, and a senior specialist (on July 20, 2023) separately. Finally, 26 patients and 11 thyroid surgeons evaluated those responses on 4 dimensions: accuracy, comprehensiveness, compassion, and satisfaction. RESULTS: Among the 30 questions and responses, ChatGPT's speed of response was faster than that of the junior specialist (8.69 [7.53-9.48] vs 4.33 [4.05-4.60]; P < .001) and the senior specialist (8.69 [7.53-9.48] vs 4.22 [3.36-4.76]; P < .001). The word count of the ChatGPT's responses was greater than that of both the junior specialist (341.50 [301.00-384.25] vs 74.50 [51.75-84.75]; P < .001) and senior specialist (341.50 [301.00-384.25] vs 104.00 [63.75-177.75]; P < .001). ChatGPT received higher scores than the junior specialist and senior specialist in terms of accuracy, comprehensiveness, compassion, and satisfaction in responding to common thyroid-related questions. CONCLUSION: ChatGPT performed better than a junior specialist and senior specialist in answering common thyroid-related questions, but further research is needed to validate the logical ability of the ChatGPT for complex thyroid questions.
引用
- Guo S, Li R, Li G, et al. Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients. J Clin Endocrinol Metab. 2025. PMID: 38597169. doi:10.1210/clinem/dgae235
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。