文献速递关节外科

ChatGPT与关节置换培训护士对全髋关节置换术后患者常见问题的回答适当性比较

Appropriateness of Frequently Asked Patient Questions Following Total Hip Arthroplasty From ChatGPT Compared to Arthroplasty-Trained Nurses.
PubMed 文献 · J Arthroplasty · 2024-04-16

研究前瞻性创建60个全髋关节置换术后常见问题,由关节置换培训护士和ChatGPT-3.5分别回答,3名关节置换专科培训外科医生评估适当性,并对252例患者调查对两种回答的偏好与信任度。结果显示外科医生评定护士回答93.3%(56/60)适当,ChatGPT回答95.0%(57/60)适当;69.4%(175/252)患者对ChatGPT回答更舒适,但79.0%(199/252)对信任AI回答术后问题表示不确定。

要点

  • 外科医生评定ChatGPT回答适当率为95.0%(57/60),护士为93.3%(56/60)。
  • 69.4%(175/252)患者对ChatGPT回答更舒适,30.6%(77/252)偏好护士回答。
  • 79.0%(199/252)患者对信任AI回答术后问题表示不确定。

核心结论

  • 从医生角度看,ChatGPT提供了适当的回答;患者对ChatGPT回答比关节置换培训护士回答更舒适,但多数患者对信任AI回答术后问题表示不确定。

研究设计与样本

  • 前瞻性创建60个全髋关节置换术后最常见患者问题,从关节置换培训护士和ChatGPT-3.5获取回答,由3名关节置换专科培训外科医生按临床判断分级,并对252例患者进行问卷调查。

主要发现

  • 3名关节置换专科培训外科医生评定护士回答56/60(93.3%)为适当,ChatGPT回答57/60(95.0%)为适当。
  • 175/252(69.4%)患者对ChatGPT回答更舒适,77/252(30.6%)偏好关节置换培训护士回答。
  • 199/252(79.0%)患者对信任AI回答术后问题表示不确定。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: The use of ChatGPT (Generative Pretrained Transformer), which is a natural language artificial intelligence model, has gained unparalleled attention with the accumulation of over 100 million users within months of launching. As such, we aimed to compare the following: 1) orthopaedic surgeons' evaluation of the appropriateness of the answers to the most frequently asked patient questions after total hip arthroplasty; and 2) patients' evaluation of ChatGPT and arthroplasty-trained nurses responses to answer their postoperative questions. METHODS: We prospectively created 60 questions to address the most commonly asked patient questions following total hip arthroplasty. We obtained answers from arthroplasty-trained nurses and from the ChatGPT-3.5 version for each of the questions. Surgeons graded each set of responses based on clinical judgment as 1) "appropriate," 2) "inappropriate" if the response contained inappropriate information, or 3) "unreliable" if the responses provided inconsistent content. Each patient was given a randomly selected question from the 60 aforementioned questions, with responses provided by ChatGPT and arthroplasty-trained nurses, using a Research Electronic Data Capture survey hosted at our local hospital. RESULTS: The 3 fellowship-trained surgeons graded 56 out of 60 (93.3%) responses for the arthroplasty-trained nurses and 57 out of 60 (95.0%) for ChatGPT to be "appropriate." There were 175 out of 252 (69.4%) patients who were more comfortable following the ChatGPT responses and 77 out of 252 (30.6%) who preferred arthroplasty-trained nurses' responses. However, 199 out of 252 patients (79.0%) responded that they were "uncertain" with regard to trusting AI to answer their postoperative questions. CONCLUSIONS: ChatGPT provided appropriate answers from a physician perspective. Patients were also more comfortable with the ChatGPT responses than those from arthroplasty-trained nurses. Inevitably, its successful implementation is dependent on its ability to provide credible information that is consistent with the goals of the physician and patient alike.

来源:J Arthroplasty,查看原文。版权归原作者所有。

引用

  1. Dubin JA, Bains SS, DeRogatis MJ, et al. Appropriateness of Frequently Asked Patient Questions Following Total Hip Arthroplasty From ChatGPT Compared to Arthroplasty-Trained Nurses. J Arthroplasty. 2024. PMID: 38626863. doi:10.1016/j.arth.2024.04.020

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。