使用经验证的目标结构化技术评估技能量表验证简易腹腔镜卵巢囊肿切除术模型的建构效度
本研究在学术教学医院纳入26名妇产科住院医师(15名初级、11名高级),开发简易低成本腹腔镜卵巢囊肿切除术模拟器并纳入模拟课程,年终用视频记录操作,由2名盲法腹腔镜专家用OSATS改良版5个维度评分。除组织尊重外,各维度均显示建构效度及评分者间信度。
要点
- 简易低成本腹腔镜卵巢囊肿切除术模型可用于教授重要腹腔镜技能。
- 除组织尊重维度外,各测量维度均显示建构效度与评分者间信度。
- 该模型能区分初级与高级住院医师的操作水平。
核心结论
- 该简易低成本模型可用于教授重要的腹腔镜卵巢囊肿切除术技能,并能区分初级与高级住院医师,显示建构效度。
研究设计与样本
- 前瞻性盲法观察性研究(加拿大任务force分类II.3),在学术教学医院纳入26名PGY 1至4妇产科住院医师,其中初级住院医师(PGY 1-2)15名、高级住院医师(PGY 3-4)11名。
- 开发简易低成本腹腔镜卵巢囊肿切除术模拟器并纳入模拟课程,针对初级住院医师在学年内安排一次指导与即时反馈的模拟课程;年终技能评估时用该模型录制所有级别住院医师的操作视频。
- 由2名盲法经验丰富的腹腔镜医师使用经验证的目标结构化技术评估技能量表(OSATS)对住院医师表现评分。
主要发现
- 两名盲法评分者使用OSATS改良版全球评定量表5个维度(组织尊重、时间与动作、器械操作、操作流程、特定手术知识)评估每位住院医师的视频,每个维度取两次评分的平均值。
- 采用Mann-Whitney U检验比较初级与高级住院医师各维度排名评分,采用Kendall tau β相关系数计算评分者间信度。
- 除组织尊重维度外,所有测量维度均显示建构效度与评分者间信度。
临床怎么用
- 作者认为该简易低成本模型可用于教授重要的腹腔镜卵巢囊肿切除术技能。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
STUDY OBJECTIVE: To determine the construct validity and interrater reliability of a laparoscopic ovarian cystectomy simulator using a global rating scale. DESIGN: Prospective blinded observational study (Canadian Task Force classification II.3). SETTING: Academic teaching hospital. PARTICIPANTS: A total of 26 postgraduate year (PGY) 1 to 4 gynecology and obstetrics residents were recruited (15 junior residents, postgraduate year PGY 1-2 and 11 senior residents, PGY 3-4). INTERVENTION: We developed a simple, low-cost laparoscopic ovarian cystectomy simulator and incorporated it into our simulation curriculum. The simulation was directed at junior residents with instruction and immediate feedback in a scheduled simulation session once during the academic year. At the end of the year resident skills assessment, all levels were recorded with video using this model to assess the construct validity between junior and senior residents. Resident performance was later evaluated and scored by 2 blinded, experienced laparoscopists using a validated Objective Structured Assessment of Technical Skills (OSATS). MEASUREMENT AND MAIN RESULTS: Each resident received a unique identification number and the simulated laparoscopic ovarian cystectomy procedure was filmed during the end of the year assessment. Two blinded raters evaluated the video of each resident with the modified Global Rating Scale (OSATS), using 5 of the 7 domains (respect for tissue, time and motion, instrument handling, flow of operation and knowledge of specific procedure). An average of the 2 ratings was computed for each domain, and comparisons were made using the Mann-Whitney U test. Interrater reliability was calculated using the Kendall tau β correlation coefficient. Construct validity was determined by comparing the rank scores of the junior to senior residents in each domain. Construct validity and interrater reliability was demonstrated in all of the measured domains except for respect for tissue. CONCLUSION: This simple, low-cost model can be used to teach important laparoscopic ovarian cystectomy skills. Construct validity discriminating between junior and senior residents was demonstrated using this model.
引用
- Chahine EB, Han CH, Auguste T, et al. Construct Validity of a Simple Laparoscopic Ovarian Cystectomy Model Using a Validated Objective Structured Assessment of Technical Skills. J Minim Invasive Gynecol. 2017. PMID: 28526619. doi:10.1016/j.jmig.2017.05.001
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。