文献速递妇科

使用Limbs and Things子宫切除术模型描述建立效度的过程

Use of the Limbs and Things Hysterectomy Model to Describe the Process for Establishing Validity.
PubMed 文献 · J Minim Invasive Gynecol · 2018-02-09

本研究采用Kane框架前瞻性评估Limbs and Things子宫切除术模型的效度,在3个学术医疗中心对26名住院医师等参与者进行手术室和模拟评估,结果显示整体评估的评分与泛化效度推断得到支持,但评估工具的单个组成部分未获支持。

要点

  • 手术室TLH步骤评分显著高于模拟评估(p < .001),手术室中更常标记为「胜任」。
  • 作为主刀完成的机器人加传统TLH数量与手术室myTIPreport评分无显著相关(Spearman r = .30,p = .14)。
  • 现场模拟评估者间myTIPreport一致率为71.4%(加权κ .68,95%CI .45-.90),GOALS总体评估组内相关系数 .71(95%CI .46-.85)。

核心结论

  • 当评估整体表现时,Limbs and Things和myTIPreport的评分与泛化效度推断得到支持,但评估工具的单个组成部分未获支持。

研究设计与样本

  • 前瞻性研究,采用Kane框架建立效度(加拿大任务 force 分类:II-2)。
  • 在3个学术医疗中心的手术室和模拟环境中完成全腹腔镜子宫切除术(TLH)评估。
  • 参与者包括26名妇产科住院医师(PGY3-4)、1名妇科肿瘤研究员(PGY5)和1名妇科肿瘤主治医师。

主要发现

  • 手术室TLH步骤评分显著高于模拟评估(p < .001),手术室中更常标记为「胜任」。
  • 作为主刀完成的机器人加传统TLH数量与手术室myTIPreport评分无显著相关(Spearman r = .30,p = .14)。
  • 作为主刀完成的机器人加传统TLH数量与现场模拟myTIPreport和GOALS评分显著相关(Spearman r = .39-.58,p = .001-.04)。
  • 现场模拟评估者1和2的myTIPreport评估一致率为71.4%(加权κ .68,95%CI .45-.90),GOALS总体评估组内相关系数为 .71(95%CI .46-.85)。
  • 盲法视频回顾评估者间一致率为73.1%,与经验的相关性(Spearman r = .32-.42,p = .11-.03)低于现场评估。

关键数值与推荐

  • 使用受试者工作特征曲线下面积,区分myTIPreport不胜任与胜任表现最佳的GOALS各组成部分平均分为4.3。
  • 反馈可接受性和模型真实感评分较高。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

STUDY OBJECTIVE: To demonstrate the process for establishing or refuting validity for the Limbs and Things hysterectomy model. DESIGN: Prospective study using Kane's framework for establishing validity (Canadian Task Force classification: II-2). SETTING: Total laparoscopic hysterectomy (TLH) assessments completed in the operating room (OR) and simulation at 3 academic medical centers. PARTICIPANTS: Obstetrics and gynecology residents (n = 26 postgraduate years 3-4), a gynecologic oncology fellow (postgraduate year 5), and a gynecology oncology attending. INTERVENTIONS: Participants were rated with the myTIPreport feedback application by nonblinded faculty in the OR after TLH. In-person, simulation-based assessments were provided by 2 faculty members blinded to experience level using myTIPreport and Global Operative Assessment of Laparoscopic Skills (GOALS). Videos of simulated TLHs were rated by 2 minimally invasive gynecology fellows. MEASUREMENTS AND MAIN RESULTS: OR scores for TLH steps were significantly higher than simulation assessments (p < .001) with "competent" marked more frequently in the OR. Number of robotic + conventional TLHs performed as primary surgeon was not significantly correlated with OR myTIPreport rating (Spearman r = .30, p = .14) but was significantly correlated with myTIPreport and GOALS in-person simulation ratings (Spearman r = .39-.58, p = .001-.04). Agreement between in-person simulation rater 1 and 2 myTIPreport assessments was 71.4% (weighted κ, .68; 95% confidence interval, .45-.90), and intraclass correlation for the GOALS overall assessment was .71 (95% confidence interval, .46-.85), indicating substantial agreement. Blinded video reviews showed similar agreement (73.1%) between raters but less correlation with experience (Spearman r = .32-.42, p = .11-.03) than in-person reviews. Using area under the receiver operating characteristic curve, mean score for the individual components of GOALS that best differentiated myTIPreport noncompetent and competent levels of performance was 4.3. Feedback acceptability and model realism were rated highly. CONCLUSION: The scoring and generalization validity inferences for Limbs and Things and myTIPreport are supported when global assessments of performance are evaluated but not for individual components of the assessment instruments.

来源:J Minim Invasive Gynecol,查看原文。版权归原作者所有。

引用

  1. DeStephano CC, Chen AH, Heckman MG, et al. Use of the Limbs and Things Hysterectomy Model to Describe the Process for Establishing Validity. J Minim Invasive Gynecol. 2018. PMID: 29432903. doi:10.1016/j.jmig.2018.02.003

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。