文献速递乳房整形与再造

比较医疗提供者与ChatGPT对电子健康记录中乳房再造患者问题的回答

Comparing Provider and ChatGPT Responses to Breast Reconstruction Patient Questions in the Electronic Health Record.
PubMed 文献 · Ann Plast Surg · 2024-01-01

研究从电子健康记录中提取10个乳房再造问题,分别由ChatGPT3、ChatGPT4、整形外科医生和高级执业提供者回答,并由2名整形外科医生和医学生以1-5分Likert量表评估准确性和共情,用Flesch阅读易读性评分评估可读性。结果显示提供者回答可读性优于聊天机器人,聊天机器人共情得分更高,准确性无显著差异。

要点

  • 提供者回答Flesch阅读易读性评分53.3±13.3,高于聊天机器人36.0±11.6和简短聊天机器人34.7±12.8。
  • 聊天机器人共情得分2.9±0.8,高于提供者的2.0±0.9(P<0.001)。
  • 提供者与聊天机器人准确性无显著差异(4.3±0.9 vs 4.5±0.6,P=0.170)。

核心结论

  • ChatGPT在共情和准确性方面表现突出,但可读性存在局限,应予以解决。

研究设计与样本

  • 从电子健康记录中提取10个去标识化的乳房再造问题,分别由ChatGPT3、ChatGPT4、整形外科医生和高级执业提供者回答,ChatGPT3和ChatGPT4另被要求给出简短回答;由2名整形外科医生和医学生分别以1-5分Likert量表评分准确性和共情,用Flesch阅读易读性评分测量可读性,采用双尾t检验比较评分。

主要发现

  • 提供者合并回答的Flesch阅读易读性评分53.3±13.3,高于所有聊天机器人合并回答的36.0±11.6(P<0.001)和简短聊天机器人合并回答的34.7±12.8(P<0.001)。
  • 聊天机器人合并回答的共情评分2.9±0.8,高于提供者合并回答的2.0±0.9(P<0.001)。
  • 提供者合并回答与所有聊天机器人合并回答的准确性无显著差异(4.3±0.9 vs 4.5±0.6,P=0.170),与简短聊天机器人合并回答的准确性也无显著差异(4.3±0.9 vs 4.6±0.6,P=0.128)。

临床怎么用

  • 作者认为,在整形外科决策时间有限且复杂的情况下,ChatGPT有潜力增强患者沟通。

局限性

  • ChatGPT的可读性存在局限,应予以解决。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Patient-directed Electronic Health Record (EHR) messaging is used as an adjunct to enhance patient-physician interactions but further burdens the physician. There is a need for clear electronic patient communication in all aspects of medicine, including plastic surgery. We can potentially utilize innovative communication tools like ChatGPT. This study assesses ChatGPT's effectiveness in answering breast reconstruction queries, comparing its accuracy, empathy, and readability with healthcare providers' responses. METHODS: Ten deidentified questions regarding breast reconstruction were extracted from electronic messages. They were presented to ChatGPT3, ChatGPT4, plastic surgeons, and advanced practice providers for response. ChatGPT3 and ChatGPT4 were also prompted to give brief responses. Using 1-5 Likert scoring, accuracy and empathy were graded by 2 plastic surgeons and medical students, respectively. Readability was measured using Flesch Reading Ease. Grades were compared using 2-tailed t tests. RESULTS: Combined provider responses had better Flesch Reading Ease scores compared to all combined chatbot responses (53.3 ± 13.3 vs 36.0 ± 11.6, P < 0.001) and combined brief chatbot responses (53.3 ± 13.3 vs 34.7 ± 12.8, P < 0.001). Empathy scores were higher in all combined chatbot than in those from combined providers (2.9 ± 0.8 vs 2.0 ± 0.9, P < 0.001). There were no statistically significant differences in accuracy between combined providers and all combined chatbot responses (4.3 ± 0.9 vs 4.5 ± 0.6, P = 0.170) or combined brief chatbot responses (4.3 ± 0.9 vs 4.6 ± 0.6, P = 0.128). CONCLUSIONS: Amid the time constraints and complexities of plastic surgery decision making, our study underscores ChatGPT's potential to enhance patient communication. ChatGPT excels in empathy and accuracy, yet its readability presents limitations that should be addressed.

来源:Ann Plast Surg,查看原文。版权归原作者所有。

引用

  1. Soroudi D, Gozali A, Knox JA, et al. Comparing Provider and ChatGPT Responses to Breast Reconstruction Patient Questions in the Electronic Health Record. Ann Plast Surg. 2024. PMID: 39445873. doi:10.1097/SAP.0000000000004090

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。