文献速递妇科

阴道子宫切除术模拟模型用于手术技能评估的有效性建立

Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment.
PubMed 文献 · Obstet Gynecol · 2020-01-01

本研究采用Messick效度框架,对高保真阴道手术模型上阴道子宫切除术技能进行评估。50名不同经验水平的妇产科医生和学员参与,视频由盲法专家使用改良阴道手术技能指数(10项)、整体量表(1项)和合格标准评分。经验水平与评分强相关,改良指数内部一致性优秀, cutoff值27能准确区分胜任与不胜任者。

要点

  • 高保真模型结合改良阴道手术技能指数可有效评估阴道子宫切除术技能。
  • 经验水平与改良指数和整体量表评分强相关(r=0.81和0.74)。
  • 改良指数 cutoff 值27区分胜任与不胜任者的曲线下面积0.951。

核心结论

  • 高保真阴道手术模型结合改良阴道手术技能指数或整体量表评分,可为评估阴道子宫切除术技能提供效度证据。

研究设计与样本

  • 基于Messick效度框架的模拟评估研究,纳入来自五家机构的50名妇产科培训学员和教师(11名教师,39名学员)。
  • 使用高保真阴道手术模型录制手术视频,由不知参与者身份的专家外科医生独立评估。

主要发现

  • 经验水平与改良阴道手术技能指数和整体量表评分强相关(Pearson r=0.81,P<.001;Pearson r=0.74,P<.001)。
  • 手术经验与改良指数和整体量表评分中度相关(Pearson r=0.55,P<.001;Pearson r=0.58,P<.001)。
  • 改良指数内部一致性优秀(Cronbach's alpha=0.97)。
  • 改良指数和整体量表的评分者间信度(组内相关系数)为中等至良好(0.49-0.95;0.50-0.87)。
  • 改良指数 cutoff 值27最准确区分胜任与不胜任者(曲线下面积0.951,95% CI 0.917-0.983)。

关键数值与推荐

  • 改良阴道手术技能指数 cutoff 值27用于区分胜任与不胜任外科医生。
  • 改良指数内部一致性Cronbach's alpha=0.97。
  • 评分者间信度组内相关系数0.49-0.95(改良指数)和0.50-0.87(整体量表)。

临床怎么用

  • 可使用高保真阴道手术模型和改良阴道手术技能指数或整体量表评分来评估阴道子宫切除术技能。
  • 改良指数 cutoff 值27可作为判定胜任力的参考标准。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: To use the Messick validity framework for a simulation-based assessment of vaginal hysterectomy skills. METHODS: Video recordings of physicians at different levels of training and experience performing vaginal hysterectomy on a high-fidelity vaginal surgery model were objectively assessed using a modified 10-item Vaginal Surgical Skills Index, a one-item global scale of overall performance, and a pass-fail criterion. Participants included obstetrics and gynecology trainees and faculty from five institutions. Video recordings were independently assessed by expert surgeons blinded to the identities of the study participants. RESULTS: Fifty surgeons (11 faculty, 39 trainees) were assessed. Experience level correlated strongly with both the modified Vaginal Surgical Skills Index and global scale score, with more experienced participants receiving higher scores (Pearson r=0.81, P<.001; Pearson r=0.74, P<.001). Likewise, surgical experience was also moderately correlated with the modified Vaginal Surgical Skills Index and global scale score (Pearson r=0.55, P<.001; Pearson r=0.58, P<.001). The internal consistency of the modified Vaginal Surgical Skills Index was excellent (Cronbach's alpha=0.97). Interrater reliability of the modified Vaginal Surgical Skills Index and global scale score, as measured by the intraclass correlation coefficient, was moderate to good (0.49-0.95; 0.50-0.87). Using the receiver operating characteristic curve and the pass-fail criterion, a modified Vaginal Surgical Skills Index cutoff score of 27 was found to most accurately (area under the curve 0.951, 95% CI 0.917-0.983) differentiate competent from noncompetent surgeons. CONCLUSION: We demonstrated validity evidence for using a high-fidelity vaginal surgery model with the modified Vaginal Surgical Skills Index or global scale score to assess vaginal hysterectomy skills.

来源:Obstet Gynecol,查看原文。版权归原作者所有。

引用

  1. Chen CCG, Lockrow EG, DeStephano CC, et al. Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment. Obstet Gynecol. 2020. PMID: 33030877. doi:10.1097/AOG.0000000000004085

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。