文献速递甲状腺疾病

比较ChatGPT与外科医生对患者甲状腺相关问题的回答

Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients.
PubMed 文献 · J Clin Endocrinol Metab · 2025-01-01

这项横断面研究从华医通应用获取28个甲状腺相关问题,加2个干扰问题共30题,由ChatGPT(GPT-4.0)、初级和高级专科医生分别回答,26例患者和11名甲状腺外科医生从准确性、全面性、同理心和满意度4个维度评估。ChatGPT回答速度快于初级和高级专科医生,字数更多,4个维度得分均更高,但需进一步研究验证其处理复杂甲状腺问题的逻辑能力。

要点

  • ChatGPT回答速度8.69[7.53-9.48]快于初级4.33[4.05-4.60]和高级4.22[3.36-4.76]专科医生(均P<.001)。
  • ChatGPT回答字数341.50[301.00-384.25]多于初级74.50[51.75-84.75]和高级104.00[63.75-177.75](均P<.001)。
  • ChatGPT在准确性、全面性、同理心和满意度4个维度得分均高于初级和高级专科医生。

核心结论

  • ChatGPT在回答常见甲状腺相关问题方面表现优于初级和高级专科医生,但需进一步研究验证其处理复杂甲状腺问题的逻辑能力。

研究设计与样本

  • 横断面研究,从华医通应用获取28个甲状腺相关问题,加2个干扰问题共30题,由ChatGPT(GPT-4.0)、1名初级专科医生和1名高级专科医生分别回答(ChatGPT于2023年7月19日、医生于2023年7月20日)。
  • 由26例患者和11名甲状腺外科医生对回答进行评分。

主要发现

  • ChatGPT回答速度8.69[7.53-9.48]快于初级专科医生4.33[4.05-4.60](P<.001)和高级专科医生4.22[3.36-4.76](P<.001)。
  • ChatGPT回答字数341.50[301.00-384.25]多于初级专科医生74.50[51.75-84.75](P<.001)和高级专科医生104.00[63.75-177.75](P<.001)。
  • ChatGPT在准确性、全面性、同理心和满意度4个维度得分均高于初级和高级专科医生。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 需进一步研究验证ChatGPT处理复杂甲状腺问题的逻辑能力。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

CONTEXT: For some common thyroid-related conditions with high prevalence and long follow-up times, ChatGPT can be used to respond to common thyroid-related questions. OBJECTIVE: In this cross-sectional study, we assessed the ability of ChatGPT (version GPT-4.0) to provide accurate, comprehensive, compassionate, and satisfactory responses to common thyroid-related questions. METHODS: First, we obtained 28 thyroid-related questions from the Huayitong app, which together with the 2 interfering questions eventually formed 30 questions. Then, these questions were responded to by ChatGPT (on July 19, 2023), a junior specialist, and a senior specialist (on July 20, 2023) separately. Finally, 26 patients and 11 thyroid surgeons evaluated those responses on 4 dimensions: accuracy, comprehensiveness, compassion, and satisfaction. RESULTS: Among the 30 questions and responses, ChatGPT's speed of response was faster than that of the junior specialist (8.69 [7.53-9.48] vs 4.33 [4.05-4.60]; P < .001) and the senior specialist (8.69 [7.53-9.48] vs 4.22 [3.36-4.76]; P < .001). The word count of the ChatGPT's responses was greater than that of both the junior specialist (341.50 [301.00-384.25] vs 74.50 [51.75-84.75]; P < .001) and senior specialist (341.50 [301.00-384.25] vs 104.00 [63.75-177.75]; P < .001). ChatGPT received higher scores than the junior specialist and senior specialist in terms of accuracy, comprehensiveness, compassion, and satisfaction in responding to common thyroid-related questions. CONCLUSION: ChatGPT performed better than a junior specialist and senior specialist in answering common thyroid-related questions, but further research is needed to validate the logical ability of the ChatGPT for complex thyroid questions.

来源:J Clin Endocrinol Metab,查看原文。版权归原作者所有。

引用

  1. Guo S, Li R, Li G, et al. Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients. J Clin Endocrinol Metab. 2025. PMID: 38597169. doi:10.1210/clinem/dgae235

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。