Google与ChatGPT-4对常见颅颌面问题回答准确性与完整性比较
本研究将颅缝早闭与腭裂相关的20个常见患者问题分别输入Google和ChatGPT-4,用Flesch-Kincaid评估可读性并由盲法评审按3分制评价准确性与完整性。ChatGPT回答在完整性(2.60 vs 1.86,P<0.0001)和准确性(2.78 vs 2.09,P<0.0001)上均显著优于Google,且各病种单独分析时差异持续存在。
要点
- ChatGPT对颅缝早闭与腭裂患者问题的回答准确性和完整性均显著优于Google。
- 腭裂问题中Google回答可读性显著低于ChatGPT(9.95 vs 13.22,P=0.006)。
- 颅缝早闭问题两者可读性无显著差异(14.66 vs 14.73,P=0.467)。
核心结论
- ChatGPT对颅缝早闭常见患者问题提供比Google更准确、更全面的信息,且未牺牲可读性。
研究设计与样本
- 将「Craniosynostosis」和「Cleft Palate」输入Google,用「People Also Ask」工具各取前10个相关问题,共20个问题。
- 每个问题分别输入Google和ChatGPT,记录40条独特回答。
- 用Flesch-Kincaid工具评估可读性,盲法评审按3分制(1=完全错误,2=部分错误,3=正确)评价准确性与完整性,评审分数取平均值后用t检验比较两平台。
主要发现
- 腭裂查询中Google回答阅读水平显著低于ChatGPT(9.95 vs 13.22,P=0.006)。
- 颅缝早闭回答可读性无显著差异(14.66 vs 14.73,P=0.467)。
- 全部问题中ChatGPT回答完整性显著更高(2.60 vs 1.86,P<0.0001)。
- 全部问题中ChatGPT回答准确性显著更高(2.78 vs 2.09,P<0.0001)。
- 上述差异在各病种单独分析时持续存在。
临床怎么用
- 临床中可考虑引导患者使用ChatGPT获取颅缝早闭相关常见问题的初步信息,再据此进行后续检索。
- 向患者推荐资源时需注意Google在腭裂问题上可读性较低、准确性与完整性不足。
局限性
- 原文未报告需进一步评估患者从两种搜索引擎实际学到的信息,以帮助临床医生引导患者选择最适合个体照护的资源。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Patients often use Google as a source of quick medical information, although the accuracy and clarity of search results can vary. ChatGPT has emerged as an alternative tool capable of providing conversational and potentially more reliable medical information. This study compares the readability, accuracy, and completeness of responses generated by ChatGPT with those obtained using Google for common patient questions regarding craniosynostosis and cleft palate. METHODS: The terms "Craniosynostosis" and "Cleft Palate" were entered into Google, and the top 10 associated questions for each-identified using the "People Also Ask" tool-were recorded. Each question was then entered into both Google and ChatGPT, and the responses from each were recorded. The ease of readability for each response was determined by the Flesch-Kincaid instrument. Blinded reviewers evaluated accuracy and completeness using a 3-point scale (1 = fully incorrect, 2 = partially incorrect, 3 = correct). Reviewer scores were averaged, and comparisons between platforms were evaluated using t tests. RESULTS: A total of 20 questions yielded 40 unique responses. For cleft palate queries, Google responses had significantly lower reading levels than ChatGPT (9.95 vs 13.22, P = 0.006). No significant difference in readability was observed for craniosynostosis responses (14.66 vs 14.73, P = 0.467). Across all questions, ChatGPT responses were significantly more complete (2.60 vs 1.86, P < 0.0001) and more accurate (2.78 vs 2.09, P < 0.0001) than Google responses. These differences persisted when each condition was analyzed separately. CONCLUSION: ChatGPT provides more accurate and comprehensive information than Google for common patient questions about craniosynostosis without sacrificing readability. Patients can use this information to inform their future searches in order to obtain the most accurate information about their diagnoses. Further studies evaluating the information learned by patients from both search engines can help clinicians guide patients toward resources that best fit their individual care.
引用
- Patel IS, Awad AN, Shihadeh H, et al. Comparing Accuracy and Completeness of Google Search Versus ChatGPT-4 Responses to Questions Patients Have Regarding Common Craniofacial Conditions. Ann Plast Surg. 2026. PMID: 41587425. doi:10.1097/SAP.0000000000004652
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。