文献速递烧伤

人工智能语言模型可提高烧伤急救信息的可读性

An artificial intelligence language model improves readability of burns first aid information.
PubMed 文献 · Burns · 2024-03-07

本研究评估人工智能大型语言模型改善烧伤急救信息可读性的潜力,使用ChatGPT-3将排名前50的英文烧伤急救网页内容改写为11岁儿童可理解水平,并用五种经验证工具评估可读性。结果显示,改写后达到目标可读性水平的材料比例从4%升至18%,所有可读性评分均显著改善(p < .001)。

要点

  • 使用ChatGPT-3将烧伤急救网页改写为11岁阅读水平。
  • 改写后达到目标可读性水平的材料从4%升至18%。
  • 所有可读性评分在改写后均显著改善(p < .001)。

核心结论

  • 利用人工智能语言模型是提高烧伤急救信息可读性的有效且可行的方法。

研究设计与样本

  • 研究使用人工智能语言模型ChatGPT-3改写排名前50的英文烧伤急救网页内容,目标为11岁阅读水平,采用五种经验证工具评估可读性。

主要发现

  • 原始材料中仅4%的患者教育材料在所有工具上达到目标可读性水平,中位年级为6.9(SD=1.1)。
  • 单样本单尾t检验显示原始材料可读性未显著低于目标水平(p = .31)。
  • 经AI改写后,18%的患者教育材料在所有工具上达到目标水平,中位年级为6(SD=0.9),显著低于目标水平(p < .001)。
  • 配对t检验表明改写后所有可读性评分均显著改善(p < .001)。

关键数值与推荐

  • 美国医学会和英格兰健康教育署推荐患者教育材料应达到11岁儿童可理解水平。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

AIMS: This study aimed to assess the potential of using an artificial intelligence (AI) large language model to improve the readability of burns first aid information. METHODS: An AI language model (ChatGPT-3) was used to rewrite content from the top 50 English-language webpages containing burns first aid information to be understandable by an individual with the literacy level of an 11-year-old, as recommended by the American Medical Association and Health Education England. The assessment of readability was conducted using five validated tools. RESULTS: In their original form, only 4% of the patient education materials (PEMs) met the target readability level across all tools. The median grade was 6.9 (SD=1.1). One-sample one-tailed t-test revealed that this was not significantly below the target (p = .31). After AI-modification, 18% of PEMs reached the target level using all tools, with a median grade of 6 (SD=0.9), which was significantly below the target level (p < .001). Once rewritten using AI, paired t-test demonstrated that all readability scores improved significantly (p < .001). CONCLUSION: Utilising an AI language model proved an effective and viable method for enhancing readability of burns first aid information.

来源:Burns,查看原文。版权归原作者所有。

引用

  1. Baldwin AJ. An artificial intelligence language model improves readability of burns first aid information. Burns. 2024. PMID: 38492982. doi:10.1016/j.burns.2024.03.005

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。