指南与共识乳腺技术与安全乳腺X线

评估ChatGPT为老年女性提供乳腺X线筛查建议的准确性:人工智能与癌症沟通

Evaluating ChatGPT's Accuracy in Providing Screening Mammography Recommendations among Older Women: Artificial Intelligence and Cancer Communication.
指南 / 共识 · Res Sq · 2024-01-31

本研究针对75岁及以上女性乳腺癌筛查,向ChatGPT提出12个问题和4个临床情景,连续三次生成3组回答,由多学科专家组按适当、不适当或不可靠进行评分。结果显示11/17个回答适当(64%),3个不适当(18%),2个不可靠(12%),1个未达成共识(6%)。作者认为ChatGPT有潜力提供准确健康信息,但可能给出不适当和不可靠回答,需医师监督。

要点

  • ChatGPT对75岁及以上女性乳腺癌筛查问题的回答适当率为64%(11/17)。
  • 18%(3/17)回答不适当,12%(2/17)不可靠,6%(1/17)未达成共识。
  • 作者认为ChatGPT可辅助提供筛查建议,但因可能给出不适当和不可靠回答,需医师监督。

核心结论

  • ChatGPT在75岁及以上女性乳腺癌筛查建议上适当率为64%(11/17),作者认为其有潜力提供准确健康信息并可辅助医疗专业人员,但可能给出不适当和不可靠回答,需医师监督。

研究设计与样本

  • 研究创建12个问题和4个临床情景,向ChatGPT连续三次提问生成3组回答,由乳腺癌筛查与老龄化交叉领域多学科专家组评分。

诊断标准与关键数值

  • 回答按适当、不适当或不可靠评分,依据评审临床判断、回答内容及三次回答间一致性,适当性通过多数共识确定。

临床应用与阅片要点

  • 作者认为ChatGPT有潜力提供准确健康信息,可辅助医疗专业人员为75岁及以上患者提供乳腺癌筛查建议,但因可能给出不适当和不可靠回答,需医师监督。

局限性

  • 作者在结论中承认ChatGPT存在局限性。
  • ChatGPT可能提供不适当和不可靠的回答。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Abstract Objective: The U.S. Preventive Services Task Force (USPSTF) recommends biennial screening mammography through age 74. Guidelines vary as to whether or not they recommended mammography screening to women aged 75 and older. This study aims to determine the ability of ChatGPT to provide appropriate recommendations for breast cancer screening in patients aged 75 years and older. Methods: 12 questions and 4 clinical vignettes addressing fundamental concepts about breast cancer screening and prevention in patients aged 75 years and older were created and asked to ChatGPT three consecutive times to generate 3 sets of responses. The responses were graded by a multi-disciplinary panel of experts in the intersection of breast cancer screening and aging . The responses were graded as 'appropriate', 'inappropriate', or 'unreliable' based on the reviewer's clinical judgment, content of the response, and whether the content was consistent across the three responses . Appropriateness was determined through a majority consensus. Results: The responses generated by ChatGPT were appropriate for 11/17 questions (64%). Three questions were graded as inappropriate (18%) and 2 questions were graded as unreliable (12%). A consensus was not reached on one question (6%) and was graded as no consensus. Conclusions: While recognizing the limitations of ChatGPT, it has potential to provide accurate health care information and could be utilized by healthcare professionals to assist in providing recommendations for breast cancer screening in patients age 75 years and older. Physician oversight will be necessary, due to the possibility of ChatGPT to provide inappropriate and unreliable responses, and the importance of accuracy in medicine.

来源:Res Sq,查看原文。版权归原作者所有。

引用

  1. Braithwaite D, Karanth SD, Divaker J, et al. Evaluating ChatGPT's Accuracy in Providing Screening Mammography Recommendations among Older Women: Artificial Intelligence and Cancer Communication. Res Sq. 2024. PMID: 38352437. doi:10.21203/rs.3.rs-3911155/v1

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。