文献速递乳腺技术与安全乳腺X线

评估使用ChatGPT准确简化以患者为中心的乳腺癌预防与筛查信息

Evaluating the Use of ChatGPT to Accurately Simplify Patient-centered Information about Breast Cancer Prevention and Screening.
PubMed 文献 · Radiol Imaging Cancer · 2024-01-01

本回顾性探索性研究于2023年3月和8月要求ChatGPT将25个乳腺癌常见问题的回答简化至六年级阅读水平。简化后平均阅读轻松度从46提升至70,阅读难度从13年级降至8.9年级,词数从193降至173,23/25(92%)简化回答被认为临床合适,但仅2/25(8%)达到六年级阅读水平,且可能产生错误信息,需医生监督。

要点

  • ChatGPT可将乳腺癌筛查与预防回答的阅读难度降低约四个年级水平。
  • 92%(23/25)简化回答临床合适,但仅8%(2/25)达到六年级阅读水平。
  • 使用该工具简化患者教育材料时需医生监督以防错误信息。

核心结论

  • ChatGPT通过将阅读难度降低四个年级水平简化了乳腺癌筛查与预防常见问题的回答,但其可能产生错误信息,使用该工具时需要医生监督。

研究设计与样本

  • 回顾性探索性研究,2023年3月和8月要求ChatGPT将25个乳腺癌问题的回答简化至六年级阅读水平,评估临床合适性、阅读轻松度及五种阅读难度量表。

诊断标准与关键数值

  • 阅读轻松度合格标准为Flesch阅读轻松度指数评分≥60;阅读难度合格标准为六年级水平。

临床应用与阅片要点

  • 作者指出,ChatGPT可能产生错误信息,使用该工具简化患者教育材料时需要医生监督。

局限性

  • 原文未报告局限性

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Purpose To evaluate the use of ChatGPT as a tool to simplify answers to common questions about breast cancer prevention and screening. Materials and Methods In this retrospective, exploratory study, ChatGPT was requested to simplify responses to 25 questions about breast cancer to a sixth-grade reading level in March and August 2023. Simplified responses were evaluated for clinical appropriateness. All original and simplified responses were assessed for reading ease on the Flesch Reading Ease Index and for readability on five scales: Flesch-Kincaid Grade Level, Gunning Fog Index, Coleman-Liau Index, Automated Readability Index, and the Simple Measure of Gobbledygook (ie, SMOG) Index. Mean reading ease, readability, and word count were compared between original and simplified responses using paired t tests. McNemar test was used to compare the proportion of responses with adequate reading ease (score of 60 or greater) and readability (sixth-grade level). Results ChatGPT improved mean reading ease (original responses, 46 vs simplified responses, 70; P < .001) and readability (original, grade 13 vs simplified, grade 8.9; P < .001) and decreased word count (original, 193 vs simplified, 173; P < .001). Ninety-two percent (23 of 25) of simplified responses were considered clinically appropriate. All 25 (100%) simplified responses met criteria for adequate reading ease, compared with only two of 25 original responses (P < .001). Two of the 25 simplified responses (8%) met criteria for adequate readability. Conclusion ChatGPT simplified answers to common breast cancer screening and prevention questions by improving the readability by four grade levels, though the potential to produce incorrect information necessitates physician oversight when using this tool. Keywords: Mammography, Screening, Informatics, Breast, Education, Health Policy and Practice, Oncology, Technology Assessment Supplemental material is available for this article. © RSNA, 2023.

来源:Radiol Imaging Cancer,查看原文。版权归原作者所有。

引用

  1. Haver HL, Gupta AK, Ambinder EB, et al. Evaluating the Use of ChatGPT to Accurately Simplify Patient-centered Information about Breast Cancer Prevention and Screening. Radiol Imaging Cancer. 2024. PMID: 38305716. doi:10.1148/rycan.230086

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。