评估谷歌Gemini对乳房再造术后问题的AI生成回答
本研究用14个乳房再造术后常见问题提示谷歌Gemini,由4名乳房再造外科医生和4名高级执业提供者按4分Likert量表评价准确性、完整性、相关性及整体质量。医生组将12/14条回答评为准确、完整、高质量,13/14条评为相关;APP组分别评为11/14、12/14、10/14和14/14条。APP组整体质量中位评分低于医生组(p=0.003),平均Flesch-Kincaid可读性评分为52.3。
要点
- 医生组将12/14条回答评为准确、完整、高质量,13/14条评为相关。
- APP组将11/14条评为准确、12/14条完整、10/14条高质量、14/14条相关。
- APP组整体质量中位评分低于医生组(p=0.003),平均可读性评分52.3。
核心结论
- 谷歌Gemini对乳房再造术后常见问题提供了相关且完整的回答。
- 「相当困难」的可读性评分可能对某些患者群体构成挑战。
- 医生与APP在「整体质量」评分上的差异可能源于医生经验更丰富,能在更广泛背景下评估回答。
- 谷歌Gemini展现出作为患者教育工具的潜力,但应建议患者咨询临床医生以获取最可靠和个性化的医疗建议。
研究设计与样本
- 本研究用14个乳房再造术后常见问题提示谷歌Gemini AI。
- 由4名经验丰富的乳房再造外科医生和4名高级执业提供者(APP)按4分Likert量表评价回答的准确性、完整性、相关性和整体质量。
- 计算中位评分作为最终评分,并将回答分类为准确与不准确、完整与不完整、相关与不相关、高质量与低质量。
- 使用Flesch-Kincaid阅读量表评估可读性。
主要发现
- 医生组将12/14条回答(86%)评为准确、12/14条(86%)评为完整、13/14条(93%)评为相关、12/14条(86%)评为高质量。
- APP组将11/14条回答(79%)评为准确、12/14条(86%)评为完整、14/14条(100%)评为相关、10/14条(71%)评为高质量。
- APP组整体质量中位评分低于医生组(p=0.003)。
- 平均Flesch-Kincaid可读性评分为52.3。
临床怎么用
- 谷歌Gemini展现出作为患者教育工具的潜力,但应建议患者咨询临床医生以获取最可靠和个性化的医疗建议。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: The purpose of this study was to evaluate Google Gemini's responses to common post-operative questions pertaining to breast reconstruction surgery. METHODS: Google Gemini AI was prompted with 14 common post-operative questions related to breast reconstruction surgery. Four experienced breast reconstructive surgeons and four advanced practice providers (APPs) evaluated the responses for accuracy, completeness, relevance, and overall quality on a 4-point Likert scale. Median scores were calculated and utilized as the final score. Responses were further categorized as accurate vs inaccurate, complete vs incomplete, relevant vs irrelevant, and high vs low quality. Readability was evaluated using the Fleisch-Kincaid reading scale. RESULTS: Attending surgeons classified 12/14 responses (86%) as accurate, 12/14 (86%) as complete, 13/14 (93%) as relevant, and 12/14 (86%) as high quality. APPs rated 11/14 responses (79%) as accurate, 12/14 (86%) as complete, 14 /14 (100%) as relevant, and 10/14 (71%) as high quality. APPs assigned lower median scores for overall quality than physicians (p=0.003). The mean Flesch-Kincaid readability score was 52.3. CONCLUSION: Google Gemini provided relevant and complete responses to common post-operative questions pertaining to breast reconstruction. The "fairly difficult" readability score may pose challenges for certain patient populations. Differences in scores between physicians and APPs for "overall quality" may be due to higher levels of experience among physicians, allowing them to evaluate answers in a broader context. While Google Gemini demonstrates potential as a tool for patient education, patients should be advised to consult with clinicians for the most reliable and personalized medical advice.
引用
- Hendizadeh AN, Schmitz N, Fritsch A, et al. Evaluating Google Gemini's AI generated responses to questions after breast reconstruction. J Plast Reconstr Aesthet Surg. 2025. PMID: 40305889. doi:10.1016/j.bjps.2025.04.021
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。