SAFE-T评估工具:用于结肠镜检查中消化内科进修医生实时表现评估的网页应用程序的衍生与验证
本研究开发并验证了SAFE-T工具,一种包含5个问题的网页应用程序,用于评估消化内科进修医生在结肠镜检查中的实时表现。研究纳入15名进修医生(每年级5名)和26名教师,完成350次评估。SAFE-T总分能区分不同培训年级(P < .0001),并随病例复杂度增加而降低;双人观察的评分者间信度kappa为0.898(P < .0001),与MCSAT总分的相关性r > 0.90(P < .0001)。
要点
- SAFE-T总分可区分第1、2、3年进修医生(均值分别为2.00、3.84、4.28,P < .0001)。
- SAFE-T总分随病例复杂度增加而降低:简单病例4.07 vs 一般病例3.50(P < .0001),一般病例3.50 vs 困难病例3.08(P = .0134)。
- 双人观察时SAFE-T的评分者间信度kappa为0.898(P < .0001),与MCSAT总分相关性r > 0.90(P < .0001)。
核心结论
- 研究开发并验证了SAFE-T评估工具,这是一种简洁的网页应用程序,用于评估消化内科进修医生在结肠镜检查中的实时表现。
研究设计与样本
- SAFE-T工具衍生为一种新颖的5问题评估工具,包含总结性和形成性反馈,并改编为网页应用程序。
- 对15名消化内科进修医生(第1至3年培训各5名)进行了前瞻性研究,使用SAFE-T工具评估。
- 一名独立评审员评估了其中一部分操作,并完成SAFE-T工具和Mayo结肠镜检查技能评估工具(MCSAT)以进行信度测试。
- 26名教师完成了对15名进修医生的350次SAFE-T评估。
主要发现
- SAFE-T总体平均分:第1年2.00,第2年3.84,第3年4.28,可区分每个连续的培训年级(P < .0001)。
- SAFE-T总体平均分随病例复杂度评分增加而降低:简单病例 vs 一般病例为4.07 vs 3.50(P < .0001),一般病例 vs 困难病例为3.50 vs 3.08(P = .0134)。
- 在双人观察的操作中,SAFE-T工具显示出极好的评分者间信度,kappa一致性统计量为0.898(P < .0001)。
- SAFE-T总体分与MCSAT总体动手操作分和个体运动分的相关性极好(每个r > 0.90,P < .0001)。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND AIMS: Attending assessment is a critical part of endoscopic education for gastroenterology fellows. The aim of this study was to develop and validate a concise assessment tool to evaluate real-time fellow performance in colonoscopy administered via a web-based application. METHODS: The Skill Assessment in Fellow Endoscopy Training (SAFE-T) tool was derived as a novel 5-question evaluation tool that captures both summative and formative feedback adapted into a web-based application. A prospective study of 15 gastroenterology fellows (5 fellows each from years 1 to 3 of training) was performed using the SAFE-T tool. An independent reviewer evaluated a subset of these procedures and completed the SAFE-T tool and Mayo Colonoscopy Skills Assessment Tool (MCSAT) for reliability testing. RESULTS: Twenty-six faculty completed 350 SAFE-T evaluations of the 15 fellows in the study. The mean SAFE-T overall score (year 1, 2.00; year 2, 3.84; year 3, 4.28) differentiated each sequential fellow year of training (P < .0001). The mean SAFE-T overall score decreased with increasing case complexity score, with straightforward cases compared with average cases (4.07 vs 3.50, P < .0001), and average cases compared with challenging cases (3.50 vs 3.08, P = .0134). In dual-observed procedures, the SAFE-T tool showed excellent inter-rater reliability with a kappa agreement statistic of 0.898 (P < .0001). Correlation of the SAFE-T overall score with the MCSAT overall hands-on and individual motor scores was excellent (each r > 0.90, P < .0001). CONCLUSIONS: We developed and validated the SAFE-T assessment tool, a concise and web-based means of assessing real-time gastroenterology fellow performance in colonoscopy.
引用
- Kumar NL, Kugener G, Perencevich ML, et al. The SAFE-T assessment tool: derivation and validation of a web-based application for point-of-care evaluation of gastroenterology fellow performance in colonoscopy. Gastrointest Endosc. 2017. PMID: 28501594. doi:10.1016/j.gie.2017.05.005
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。