ChatGPT能准确完成妇科癌症的遗传咨询
研究用40个妇科肿瘤遗传检测与咨询问题测试ChatGPT V3.5,由两名妇科肿瘤主治医师按四级评分,第三位评审解决分歧。33/40(82.5%)回答正确且全面,遗传咨询类20/20(100%)正确且全面,遗传性乳腺癌卵巢癌综合征15/17(88.2%)、Lynch综合征2/3(66.6%)正确且全面。结论认为ChatGPT在多数问题上能准确回答遗传综合征、检测与咨询问题。
要点
- 40个问题中33/40(82.5%)回答正确且全面,0/40完全错误。
- 遗传咨询指南类问题20/20(100%)正确且全面。
- 遗传性乳腺癌卵巢癌综合征15/17(88.2%)、Lynch综合征2/3(66.6%)正确且全面。
核心结论
- ChatGPT在所研究问题中的多数能准确回答遗传综合征、遗传检测与咨询问题。
- 作者认为该工具可作为患者遗传咨询问题的资源,但需要妇科肿瘤医生提供更多数据输入以教育患者了解遗传综合征。
研究设计与样本
- 研究由妇科肿瘤医生共同制定40个问题,改编自专业学会指南,查询ChatGPT V3.5。
- 问题分两类:遗传咨询指南和特定遗传疾病。
- 由两名妇科肿瘤主治医师按四级评分,分歧由第三位评审解决。
主要发现
- 总体33/40(82.5%)回答正确且全面,6/40(15%)正确但不全面,1/40(2.5%)部分错误,0/40(0%)完全错误。
- 遗传咨询类问题20/20(100%)正确且全面。
- 遗传性乳腺癌卵巢癌综合征问题15/17(88.2%)正确且全面,Lynch综合征问题2/3(66.6%)正确且全面。
关键数值与推荐
- 评分标准:1)正确且全面,2)正确但不全面,3)部分正确部分错误,4)完全错误。
- 遗传咨询类问题正确且全面比例为20/20(100%)。
- 遗传性乳腺癌卵巢癌综合征问题正确且全面比例为15/17(88.2%)。
- Lynch综合征问题正确且全面比例为2/3(66.6%)。
临床怎么用
- 作者认为该工具可作为患者遗传咨询问题的资源。
- 作者指出需要妇科肿瘤医生提供更多数据输入以教育患者了解遗传综合征。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: Artificial Intelligence (AI) systems such as ChatGPT can take medical examinations and counsel patients regarding medical diagnosis. We aim to quantify the accuracy of the ChatGPT V3.4 in answering commonly asked questions pertaining to genetic testing and counseling for gynecologic cancers. METHODS: Forty questions were formulated in conjunction with gynecologic oncologists and adapted from professional society guidelines and ChatGPT version 3.5 was queried, the version that is readily available to the public. The two categories of questions were genetic counseling guidelines and questions pertaining to specific genetic disorders. The answers were scored by two attending Gynecologic Oncologists according to the following scale: 1) correct and comprehensive, 2) correct but not comprehensive, 3) some correct, some incorrect, and 4) completely incorrect. Scoring discrepancies were resolved by additional third reviewer. The proportion of responses earning each score were calculated overall and within each question category. RESULTS: ChatGPT provided correct and comprehensive answers to 33/40 (82.5%) questions, correct but not comprehensive answers to 6/40 (15%) questions, partially incorrect answers to 1/40 (2.5%) questions, and completely incorrect answers to 0/40 (0%) questions. The genetic counseling category of questions had the highest proportion of answers that were both correct and comprehensive with ChatGPT answering all 20/20 questions with 100% accuracy and were comprehensive in responses. ChatGPT performed equally in the specific genetic disorders category, with 88.2% (15/17) and 66.6% (2/3) correct and comprehensive answers to questions pertaining to hereditary breast and ovarian cancer and Lynch syndrome questions respectively. CONCLUSION: ChatGPT accurately answers questions about genetic syndromes, genetic testing, and counseling in majority of the studied questions. These data suggest this powerful tool can be utilized as a patient resource for genetic counseling questions, though more data input from gynecologic oncologists would be needed to educate patients on genetic syndromes.
引用
- Patel JM, Hermann CE, Growdon WB, et al. ChatGPT accurately performs genetic counseling for gynecologic cancers. Gynecol Oncol. 2024. PMID: 38676973. doi:10.1016/j.ygyno.2024.04.006
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。