人工智能能否提高患者教育材料的可读性
该研究评估免费AI对话平台能否将骨科患者教育材料从高中水平改写至六年级以下,并检验改写后材料的准确性与内容细节保留情况。结果显示,腰椎间盘突出、脊柱侧弯、椎管狭窄、全膝关节置换术和全髋关节置换术材料的Flesch-Kincaid年级水平均降至推荐范围,未发现事实错误,但需进一步研究其他材料和非英语材料的适用性。
要点
- 免费AI对话平台可快速将骨科患者教育材料改写至更低阅读年级水平。
- 改写后材料保留了足够细节且未发现事实错误。
- 专业组织和诊所应使用广泛可用的测量工具评估其患者教育材料的阅读水平。
核心结论
- 免费AI对话平台能快速有效地提高骨科在线患者教育材料的阅读可及性至推荐水平。
- 专业组织和诊所应使用广泛可用的测量工具确定其患者教育材料是否超过当前推荐阅读水平,然后根据需要应用AI对话平台将材料转换为更易获取的水平。
- 需要进一步研究以确定该技术是否可应用于其他告知患者的材料(如手术同意书或术后指导),以及此处展示的方法是否适用于非英语材料。
研究设计与样本
- 研究从骨科专业组织和领先骨科机构在线发布的教育材料中选取腰椎间盘突出、脊柱侧弯、椎管狭窄、全膝关节置换术和全髋关节置换术的描述。
- 将描述输入AI对话平台,提示语为「translate to fifth-grade reading level」,以将每组文本转换至六年级或以下阅读水平。
- 选择五年级阅读水平是为了考虑AI平台定义可读性方式的潜在差异,因为现有多种广泛使用的可读性水平定义方法。
- 在AI转换前后分别测定每个描述的Flesch Reading Ease评分和Flesch-Kincaid年级水平,并记录转换时间。
- 审查每份教育材料及其转换版本的事实不准确性,并审查每个转换版本是否保留了作为患者教育文档预期用途的足够细节。
主要发现
- 向公众展示的当前腰椎间盘突出描述的中位(范围)Flesch-Kincaid年级水平为9.5(9.1至10.5),脊柱侧弯为12.6(10.8至15),椎管狭窄为10.9(8至13.6)。
- 经AI对话平台转换后,腰椎间盘突出、脊柱侧弯和椎管狭窄的中位Flesch-Kincaid年级水平分别为5.0(3.3至8.2)、5.6(4.1至7.3)和6.9(5至7.8)。
- 全膝关节置换术和全髋关节置换术描述分别从12.0(11.2至13.5)改善至6.3(5.8至7.6)和从11.6(9.5至12.6)改善至6.1(5.4至7.1)。
- Flesch Reading Ease评分呈现相似趋势。
- 脊柱疾病和关节置换术的每句转换时间中位数分别为4.5秒(3.3至4.9)和4.5秒(3.5至4.8)。
关键数值与推荐
- 在线健康教育材料的推荐可读性为六年级至八年级或以下水平。
- 超过十年的研究表明,大多数骨科在线教育材料不符合这些推荐。
- AI对话平台提示语为「translate to fifth-grade reading level」,以将文本转换至六年级或以下阅读水平。
临床怎么用
- 专业组织和诊所应使用广泛可用的测量工具确定其患者教育材料是否超过当前推荐阅读水平。
- 如有需要,应用AI对话平台将材料转换为更易获取的水平。
局限性
- 需要进一步研究以确定该技术是否可应用于其他告知患者的材料,如手术同意书或术后指导。
- 需要进一步研究以确定此处展示的方法是否适用于非英语材料。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: The recommended readability of online health education materials is at or below the sixth- to eighth-grade level. Nevertheless, more than a decade of research has demonstrated that most online education materials pertaining to orthopaedic surgery do not meet these recommendations. The repeated evidence of this limited progress underscores that unaddressed barriers exist to improving readability, such as the added time and cost associated with writing easily readable materials that cover complex topics. Freely available artificial intelligence (AI) platforms might facilitate the conversion of patient-education materials at scale, but to our knowledge, this has not been evaluated in orthopaedic surgery. QUESTIONS/PURPOSES: (1) Can a freely available AI dialogue platform rewrite orthopaedic patient education materials to reduce the required reading skill level from the high-school level to the sixth-grade level (which is approximately the median reading level in the United States)? (2) Were the converted materials accurate, and did they retain sufficient content detail to be informative as education materials for patients? METHODS: Descriptions of lumbar disc herniation, scoliosis, and spinal stenosis, as well as TKA and THA, were identified from educational materials published online by orthopaedic surgery specialty organizations and leading orthopaedic institutions. The descriptions were entered into an AI dialogue platform with the prompt "translate to fifth-grade reading level" to convert each group of text at or below the sixth-grade reading level. The fifth-grade reading level was selected to account for potential variation in how readability is defined by the AI platform, given that there are several widely used preexisting methods for defining readability levels. The Flesch Reading Ease score and Flesch-Kincaid grade level were determined for each description before and after AI conversion. The time to convert was also recorded. Each education material and its respective conversion was reviewed for factual inaccuracies, and each conversion was reviewed for its retention of sufficient detail for intended use as a patient education document. RESULTS: As presented to the public, the current descriptions of herniated lumbar disc, scoliosis, and stenosis had median (range) Flesch-Kincaid grade levels of 9.5 (9.1 to 10.5), 12.6 (10.8 to 15), and 10.9 (8 to 13.6), respectively. After conversion by the AI dialogue platform, the median Flesch-Kincaid grade level scores for herniated lumbar disc, scoliosis, and stenosis were 5.0 (3.3 to 8.2), 5.6 (4.1 to 7.3), and 6.9 (5 to 7.8), respectively. Similarly, descriptions of TKA and THA improved from 12.0 (11.2 to 13.5) to 6.3 (5.8 to 7.6) and from 11.6 (9.5 to 12.6) to 6.1 (5.4 to 7.1), respectively. The Flesch Reading Ease scores followed a similar trend. Seconds per sentence conversion was median 4.5 (3.3 to 4.9) and 4.5 (3.5 to 4.8) for spine conditions and arthroplasty, respectively. Evaluation of the materials that were converted for ease of reading still provided a sufficient level of nuance for patient education, and no factual errors or inaccuracies were identified. CONCLUSION: We found that a freely available AI dialogue platform can improve the reading accessibility of orthopaedic surgery online patient education materials to recommended levels quickly and effectively. Professional organizations and practices should determine whether their patient education materials exceed current recommended reading levels by using widely available measurement tools, and then apply an AI dialogue platform to facilitate converting their materials to more accessible levels if needed. Additional research is needed to determine whether this technology can be applied to additional materials meant to inform patients, such as surgical consent documents or postoperative instructions, and whether the methods presented here are applicable to non-English language materials.
引用
- Kirchner GJ, Kim RY, Weddle JB, et al. Can Artificial Intelligence Improve the Readability of Patient Education Materials? Clin Orthop Relat Res. 2023. PMID: 37116006. doi:10.1097/CORR.0000000000002668
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。