髋部导针导航模拟器专家表现基准研究
本研究比较113名外科医生(68名住院医为新手,45名专家)在髋部导针导航模拟任务中的表现,使用TIP-APEX距离、透视次数、决策错误等指标及IDEA综合评分。专家IDEA评分显著高于新手(0.62 vs -0.21,p<0.001),提出IDEA 0.5作为熟练度基准,75%专家和13%新手达到。
要点
- 专家模拟表现显著优于新手,IDEA评分差异0.83(95%CI 0.58-1.07,p<0.001)。
- 建议IDEA 0.5作为熟练度基准,75%专家但仅13%新手达到。
- 专家平均TAD 13±5 mm、时间117±60秒、透视17±8次、决策错误5±4次。
核心结论
- CROWNS模拟器和IDEA综合评分能可靠区分专家与新手表现。
- IDEA 0.5可作为住院医熟练度基准,代表安全参与手术室的准备度。
研究设计与样本
- 实验性评估外科模拟平台,113名外科医生参与,包括68名骨科住院医(新手)和45名专家(28名OTA fellow和17名执业骨科医生)。
- 专家完成三个模拟患者场景,新手仅完成简单场景。
主要发现
- 专家组完成三个场景平均时间117±60秒,透视17±8次,TAD 13±5 mm,决策错误5±4次,角度误差1.4°±1.8°,IDEA评分0.65±0.4。
- 新手组完成单一场景时间207±88秒,透视22±10次,TAD 20±7 mm,决策错误14±7次,角度误差3.2°±3.0°,IDEA评分-0.21±0.7。
- 共享简单场景中专家IDEA评分0.62±0.3,新手-0.21±0.7,平均差异0.83(95%CI 0.58-1.07),p<0.001。
- 专家IDEA平均0.65约相当于新手完成前11例导针导航手术后的预期表现。
关键数值与推荐
- IDEA评分0.5被提议为平衡的熟练度基准,75%专家和13%新手达到。
- IDEA评分结合TAD、角度误差和决策错误三个标准化组分,值越高表现越好。
临床怎么用
- 基于模拟的客观熟练度标准(如髋部骨折固定IDEA评分0.5)可指导胜任力进阶,确保住院医达到安全手术室操作所需技术技能。
局限性
- 未来需评估此类基准如何转化为真实世界结果,以及能否优化以进一步改善手术培训和患者安全。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Simulator-based training addresses a pressing need to move surgical skill acquisition from the operating room to the laboratory, reducing patient risk associated with traditional trial-and-error training methods. The Core Requisites of Orthopedic Wire Navigation Skills (CROWNS) curriculum employs a hybrid reality simulator to teach surgeons the foundational skill of placing a guidewire in bone via fluoroscopic imaging. Simulator-based training has already been shown to improve subsequent operating room performance, but objective benchmarks to assess skill proficiency are lacking. QUESTIONS/PURPOSES: The objective of this study was to measure and compare expert and novice performance on a simulated hip wire navigation task as a basis to define candidate proficiency training benchmarks. METHODS: This study was designed as an experimental assessment of a surgical simulation platform to differentiate between skill levels during a proctored examination. In all, 113 surgeons participated, including 68 orthopaedic residents (novices) and 45 experts (28 Orthopaedic Trauma Association fellows and 17 practicing orthopaedic surgeons). To achieve the primary objective of measuring and comparing expert and novice performance, all participants performed a simulated hip wire navigation task replicating guide wire placement for intertrochanteric fracture fixation. Experts completed three simulated patient scenarios: one represented a straightforward case with clear imaging and a typical femoral neck-shaft angle (∼ 135°), another required a steeper guidewire trajectory to match an increased neck-shaft angle, and another involved a slightly malreduced fracture with an imperfect lateral view, requiring greater judgment to determine appropriate wire placement. Novices completed only the straightforward case scenario. Performance metrics included tip-apex distance (TAD), fluoroscopic image count, time, decision errors, the angle of off-target adjustments, and the previously reported Image-based Decision Error Analysis (IDEA) composite score. The IDEA score is normalized, meaning that a participant's score reflects the number of SDs above or below the mean performance across a large resident cohort. Assuming a normal distribution of scores, 95% of participants would be expected to score between -2 and +2. Higher values indicate better performance generally associated with more surgical experience. The score combines three normalized components-TAD, angle error, and decision errors-where lower TAD and smaller or fewer errors yield a more positive score. Statistical analyses compared novice and expert cohorts to help inform proficiency benchmark recommendations. The expert cohort's simulator-based IDEA scores were then compared with prior intraoperative IDEA scores from residents. RESULTS: The expert cohort completed all three simulated patient scenarios with a mean ± SD time of 117 ± 60 seconds, using 17 ± 8 images, and achieving a TAD of 13 ± 5 mm. The expert cohort had 5 ± 4 decision errors, angle errors of 1.4° ± 1.8°, and an IDEA score of 0.65 ± 0.4. The novice cohort completed their single patient scenario with a time of 207 ± 88 seconds, using 22 ± 10 images, and achieving a TAD of 20 ± 7 mm. The novice cohort had 14 ± 7 decision errors, angle errors of 3.2° ± 3.0°, and an IDEA score of -0.21 ± 0.7. When comparing the performance of the expert and novice cohorts in the single shared case scenario, the expert cohort achieved a substantially higher IDEA score (0.62 ± 0.3 and -0.21 ± 0.7, respectively, mean difference 0.83 [95% confidence interval 0.58 to 1.07]; p < 0.001). Based on prior research linking simulator performance to actual surgical experience, the expert IDEA mean score of 0.65 was roughly comparable to a performance expected in novices after their first 11 completed wire navigation surgical cases. An IDEA score of 0.5 is proposed as a balanced proficiency benchmark, achieved by 75% of experts but only 13% of novices. CONCLUSION: The CROWNS simulator and IDEA composite score reliably distinguished expert from novice performance, underscoring the need for deliberate practice and targeted feedback to close the novice-expert gap. A benchmark IDEA score of 0.5 offers a rigorous yet attainable goal for residents, representing readiness for safe and efficient operating room participation. CLINICAL RELEVANCE: Objective, simulation-based proficiency standards-such as attaining an IDEA score of 0.5 for hip fracture pinning-can guide competency-based progression, ensuring that residents achieve the technical skill required for safe operating room performance. Future research should evaluate how such benchmarks translate to real-world outcomes and whether they can be optimized to further improve surgical training and patient safety.
引用
- Long S, Thomas GW, Anderson DD, et al. Expert Performance on a Hip Wire Navigation Simulator Provides a Basis for Establishing Benchmarks to Define Skill Proficiency. Clin Orthop Relat Res. 2026. PMID: 41790861. doi:10.1097/CORR.0000000000003877
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。