文献速递牙体牙髓病

AI聊天机器人对牙外伤病例查询的表现:提示与内容工程的影响

Artificial Intelligence Chatbots' Performance on Dental Trauma Case-based Queries: Examining the Effect of Prompt and Content Engineering.
PubMed 文献 · J Endod · 2026-05-29

本研究由牙髓病专家设计4个牙外伤场景,向4种AI聊天机器人分别以非专业表述和参照国际牙外伤协会指南的牙髓医生提示提问,由2名评估者按5分制评价有效性、完整性和相关性。牙髓医生提示的回答在三个维度上均显著更优,但患者通常难以如此提问,提示直接依赖AI工具需谨慎。

要点

  • 结构化专业提示可显著提升AI回答牙外伤问题的有效性、完整性和相关性。
  • 普通患者不太可能按专业指南方式提问,可能获得质量较低的回答。
  • 牙外伤场景中不应脱离专业判断直接依赖AI聊天机器人的指导。

核心结论

  • AI聊天机器人对牙外伤指导的质量与提问方式显著相关,结构化专业提示回答更可靠。

研究设计与样本

  • 由牙髓病专家设计4个牙外伤场景,向4种AI聊天机器人分别用非专业表述和参照国际牙外伤协会指南的牙髓医生提示提问,2名评估者独立按5分制评价。

主要发现

  • 牙髓医生提示的回答在有效性上获高评分的比值比OR=1.82(95%CI:1.35-2.38,P<.001)。
  • 牙髓医生提示的回答在完整性上获高评分的OR=2.50(95%CI:1.85-3.33,P<.001)。
  • 牙髓医生提示的回答在相关性上获高评分的OR=2.94(95%CI:2.04-4.17,P<.001)。
  • 以评分≥4为可接受阈值时,牙髓医生提问的回答在基于标准的分析和总体分析中均更常被接受(P<.05)。

关键数值与推荐

  • 采用5点序数量表评价有效性、完整性和相关性。
  • 可接受性阈值定义为评分≥4。

临床怎么用

  • 临床中可借助结构化专业提示改善AI对牙外伤问题的回答质量。
  • 患者自行使用AI获取牙外伤指导时,应提醒其回答可能不可靠并寻求专业评估。

局限性

  • 研究仅纳入4个牙外伤场景和4种AI聊天机器人,结果外推需谨慎。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

INTRODUCTION: Traumatic dental injuries (TDIs) require prompt and accurate guidance, yet little is known about how the prompting influences the quality of artificial intelligence (AI) chatbot responses in these situations. METHODS: Four dental trauma scenarios were developed by expert endodontists. For each scenario, a series of questions was posed to 4 AI chatbots (Claude Sonnet 3.5, Microsoft Copilot, GPT-4, Gemini Pro 2.5) using 2 approaches: unprompted layperson phrasing (n = 10) and endodontist's prompts referencing International Association of Dental Traumatology guidelines (n = 10). Responses were independently evaluated by 2 raters for validity, completeness, and relevance using a 5-point ordinal scale. RESULTS: Scores (n = 1920) of responses to endodontist questions were associated with significantly higher odds of receiving superior ratings across all 3 domains: validity (odds ratio [OR] = 1.82; 95% confidence interval [CI]: 1.35-2.38; P < .001); completeness (OR = 2.50; 95% CI: 1.85-3.33; P < .001) and relevance (OR = 2.94; 95% CI: 2.04-4.17; P < .001). When a threshold-based acceptability (score ≥4) was applied, responses to endodontist queries were more often acceptable in criterion-based as well as overall analyses (P < .05). CONCLUSIONS: The quality of AI chatbot guidance in TDIs is significantly associated with how questions are asked. While clinically structured prompts yield more reliable responses, most patients facing dental trauma are unlikely to formulate questions in this way. This gap highlights an important limitation of current AI chatbot applications in TDIs and underscores the need for caution when relying on these tools without professional input.

来源:J Endod,查看原文。版权归原作者所有。

引用

  1. Ourang SA, Kahler B, Ha WN, et al. Artificial Intelligence Chatbots' Performance on Dental Trauma Case-based Queries: Examining the Effect of Prompt and Content Engineering. J Endod. 2026. PMID: 42217615. doi:10.1016/j.joen.2026.05.010

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。