文献速递头颈外科

探索人工智能聊天机器人在头颈癌手术术前咨询中的作用

Exploring the Role of Artificial Intelligence Chatbots in Preoperative Counseling for Head and Neck Cancer Surgery.
PubMed 文献 · Laryngoscope · 2023-12-21

本研究为单机构横断面调查研究,由五名经验丰富的头颈外科医生以盲法比较ChatGPT生成与浏览器搜索获得的五种常见头颈手术术前教育信息。除总词数外,两者可读性、知识内容、准确性、全面性和医疗错误数相似,ChatGPT被偏好48%。结论认为外科医生对两者评价相似,未来需研究AI咨询的医疗安全性及患者视角。

要点

  • ChatGPT生成的术前信息与公开网站信息在可读性、准确性、全面性和错误数上相似。
  • 经验丰富的头颈外科医生在48%的情况下更偏好ChatGPT生成的信息。
  • 除总词数外,两种来源的术前信息各项评价指标相似。

核心结论

  • 头颈外科医生对ChatGPT生成与 readily 可获得的在线教育材料的评价相似。
  • 人工智能技术的进一步改进可能很快为患者咨询开辟更多途径。
  • 未来对人工智能咨询的医疗安全性研究以及探索患者视角将备受关注。

研究设计与样本

  • 研究设计为横断面调查研究。
  • 研究场所为单机构三级医疗中心。
  • 使用ChatGPT生成五种常见头颈手术的术前教育信息,包括适应证、风险和恢复时间。
  • 将聊天机器人生成的信息与简单浏览器搜索获得的信息进行比较,搜索取第一个公开可用网站,排除学术文章。
  • 由五名经验丰富的头颈外科医生以盲法比较信息的准确性、可读性、全面性和错误数量。

主要发现

  • 除总词数外,ChatGPT生成的术前信息与公开可用网站相比,在可读性、知识内容、准确性、全面性和医疗错误数量上相似。
  • 经验丰富的头颈外科医生在48%的情况下偏好ChatGPT生成的信息。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: To evaluate the potential use of artificial intelligence (AI) chatbots, such as ChatGPT, in preoperative counseling for patients undergoing head and neck cancer surgery. STUDY DESIGN: Cross-Sectional Survey Study. SETTING: Single institution tertiary care center. METHODS: ChatGPT was used to generate presurgical educational information including indications, risks, and recovery time for five common head and neck surgeries. Chatbot-generated information was compared with information gathered from a simple browser search (first publicly available website excluding scholarly articles). The accuracy of the information, readability, thoroughness, and number of errors were compared by five experienced head and neck surgeons in a blinded fashion. Each surgeon then chose a preference between the two information sources for each surgery. RESULTS: With the exception of total word count, ChatGPT-generated pre-surgical information has similar readability, content of knowledge, accuracy, thoroughness, and numbers of medical errors when compared to publicly available websites. Additionally, ChatGPT was preferred 48% of the time by experienced head and neck surgeons. CONCLUSION: Head and neck surgeons rated ChatGPT-generated and readily available online educational materials similarly. Further refinement in AI technology may soon open more avenues for patient counseling. Future investigations into the medical safety of AI counseling and exploring patients' perspectives would be of strong interest. LEVEL OF EVIDENCE: N/A. Laryngoscope, 134:2757-2761, 2024.

来源:Laryngoscope,查看原文。版权归原作者所有。

引用

  1. Lee JC, Hamill CS, Shnayder Y, et al. Exploring the Role of Artificial Intelligence Chatbots in Preoperative Counseling for Head and Neck Cancer Surgery. Laryngoscope. 2023. PMID: 38126511. doi:10.1002/lary.31243

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。