GPT-4在整形外科口试案例中的表现:定量与定性分析
本研究评估GPT-4对美国整形外科委员会口试风格临床案例的应答能力,由2名认证整形外科医生对6个临床领域评分。GPT-4平均领域得分2.3-3.7,通过率91.7%和83.3%,诊断与并发症处理得分最高,案例介绍最低。定性发现GPT-4在指南案例中准确,但创伤分诊有局限。
要点
- GPT-4在整形外科口试案例中通过率83.3%-91.7%。
- 诊断和并发症处理领域表现最佳,案例介绍最差。
- 创伤分诊判断存在局限,需专科数据优化。
核心结论
- GPT-4在结构化整形外科场景中与 board 级临床推理具有一致性,但启发式判断和实时适应性有限,需专科训练数据优化。
主要发现
- GPT-4平均领域得分范围为2.3至3.7,通过率分别为91.7%(评分者1)和83.3%(评分者2)。
- 得分最高的领域为诊断(84.4%)和并发症处理(82.3%),最低为案例介绍(62.5%)。
- 各领域评分者间一致性较强(κ=0.70-0.89)。
- 定性发现强调GPT-4在指南案例中准确,但在创伤分诊方面存在局限,并可作为教育资源。
临床怎么用
- GPT-4可作为外科教育和口试准备的补充工具,但需注意其在创伤分诊和实时适应性方面的局限。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: The use of artificial intelligence (AI) in medicine is rapidly evolving. However, its role in plastic and reconstructive surgery remains underexplored. Plastic surgery requires nuanced, dynamic decision making, and individualized care, making AI integration challenging. This study evaluates GPT-4's ability to respond to American Board of Plastic Surgery (ABPS) Oral Board-style clinical vignettes and assesses its potential as a decision making and educational adjunct. METHODS: Twelve clinical vignettes spanning aesthetic, reconstructive, hand, craniofacial, pediatric, and trauma surgery were input into GPT-4. Each response was scored by 2 board-certified plastic surgeons across 6 clinical domains: Case Introduction, Diagnosis, Treatment Planning, Patient Counseling, Operative Steps, and Complication Management. Domains were scored on a 0-4 scale; scores <2 were considered failing. Interrater reliability was assessed via weighted κ . A structured qualitative interview was conducted. RESULTS: GPT-4 achieved mean domain scores ranging from 2.3 to 3.7 across vignettes, with passing rates of 91.7% (rater 1) and 83.3% (rater 2). The highest-performing domains were Diagnosis (84.4%) and Complication Handling (82.3%), and the lowest-performing domains were seen in Case Introductions (62.5%). Interrater agreement was strong across domains ( κ = 0.70-0.89). Qualitative findings emphasized GPT-4's accuracy in guideline-based cases, limitations in trauma triage, and potential as an educational resource. CONCLUSION: GPT-4 demonstrates concordance with board-level clinical reasoning in structured plastic surgery scenarios. However, limitations in heuristic judgment and real-time adaptability underscore the need for optimization with specialty-specific training datasets and performance rubrics. With appropriate curation, GPT-4 could serve as a valuable supplement in surgical education and oral board preparation.
引用
- Salvato JS, Salvato JC, Byrnes YM, et al. Evaluating GPT-4 Performance on Plastic Surgery Oral Examination Vignettes: A Quantitative and Qualitative Analysis. Ann Plast Surg. 2026. PMID: 41662672. doi:10.1097/SAP.0000000000004671
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。