先进人工智能模型在年轻恒牙牙髓治疗中的表现:ChatGPT-4 Omni、DeepSeek与Gemini Advanced在准确性、完整性、响应时间及可读性方面的比较
本研究评估并比较了三种先进聊天机器人ChatGPT-4 Omni、DeepSeek和Gemini Advanced在回答年轻恒牙牙髓治疗相关问题上的表现。主要结局为准确性、完整性和可读性,次要结局为响应时间及参数间相关性。结果显示ChatGPT-4o和DeepSeek在准确性和完整性上优于Gemini Advanced,Gemini Advanced响应最快,DeepSeek可读性最高而ChatGPT-4o最低。
要点
- ChatGPT-4o和DeepSeek在准确性和完整性上优于Gemini Advanced。
- Gemini Advanced响应时间最快,但准确性和完整性较低。
- 准确性与完整性正相关,与可读性无显著相关。
核心结论
- ChatGPT-4o和DeepSeek在准确性和完整性上优于Gemini Advanced。
- DeepSeek可读性得分最高,ChatGPT-4o最低。
- 临床应用需综合考虑AI回答的质量、可读性和响应时间。
研究设计与样本
- 基于美国牙髓病学家协会临床资源开发21个问题,由3名儿童牙科医生和3名牙髓病医生评估。
- 比较ChatGPT-4o、DeepSeek和Gemini Advanced的回答表现。
主要发现
- 三种聊天机器人在准确性(P < .05)和完整性(P < .05)得分上存在显著差异。
- Gemini Advanced响应时间最快(P < .001)。
- 准确性与完整性得分相关(ρ: .719, P < .001)。
- 响应时间与完整性呈正相关(ρ: .144, P < .05)。
- 准确性与可读性无显著相关(P > .05)。
关键数值与推荐
- 可读性评估采用Flesch Kincaid阅读易读性评分、Flesch Kincaid年级水平、Gunning Fog评分、SMOG指数和Coleman Liau指数。
临床怎么用
- 选择AI辅助牙髓治疗问答时,应优先考虑准确性和完整性较高的模型。
- 需结合可读性评估AI回答的临床适用性。
- 响应时间不应作为唯一选择标准。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: This study aims to evaluate and compare the performance of three advanced chatbots-ChatGPT-4 Omni (ChatGPT-4o), DeepSeek, and Gemini Advanced-on answering questions related to pulp therapies for immature permanent teeth. The primary outcomes assessed were accuracy, completeness, and readability, while secondary outcomes focused on response time and potential correlations between these parameters. METHODS: A total of 21 questions were developed based on clinical resources provided by the American Association of Endodontists, including position statements, clinical considerations, and treatment options guides, and assessed by three experienced pediatric dentists and three endodontists. Accuracy and completeness scores, as well as response times, were recorded, and readability was evaluated using Flesch Kincaid Reading Ease Score, Flesch Kincaid Grade Level, Gunning Fog Score, SMOG Index, and Coleman Liau Index. RESULTS: Results revealed significant differences in accuracy (P < .05) and completeness (P < .05) scores among the chatbots, with ChatGPT-4o and DeepSeek outperforming Gemini Advanced in both categories. Significant differences in response times were also observed, with Gemini Advanced providing the quickest responses (P < .001). Additionally, correlations were found between accuracy and completeness scores (ρ: .719, P < .001), while response time showed a positive correlation with completeness (ρ: .144, P < .05). No significant correlation was found between accuracy and readability (P > .05). CONCLUSIONS: ChatGPT-4o and DeepSeek demonstrated superior performance in terms of accuracy and completeness when compared to Gemini Advanced. Regarding readability, DeepSeek scored the highest, while ChatGPT-4o showed the lowest. These findings highlight the importance of considering both the quality and readability of artificial intelligence-driven responses, in addition to response time, in clinical applications.
引用
- Sezer B, Aydoğdu T. Performance of Advanced Artificial Intelligence Models in Pulp Therapy for Immature Permanent Teeth: A Comparison of ChatGPT-4 Omni, DeepSeek, and Gemini Advanced in Accuracy, Completeness, Response Time, and Readability. J Endod. 2025. PMID: 40850544. doi:10.1016/j.joen.2025.08.011
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。