基于视频的ERCP技术技能评估工具的开发和初步验证
本研究旨在开发和验证一种基于视频的ERCP技能评估工具(BESAT)。通过任务分解、2轮改良德尔菲法和3次验证练习迭代优化,最终工具包含6个技术要素和11个子要素。最新版BESAT-v4的泛化系数为0.67,BESAT评分中43.55%的方差归因于内镜医师技能差异,表明该工具可通过视频分析可靠区分内镜医师。
要点
- BESAT工具经任务分解和迭代优化,最终包含6个技术要素和11个子要素。
- 最新版BESAT-v4的泛化系数(信度指数)为0.67。
- BESAT评分中43.55%的方差归因于内镜医师技能差异。
核心结论
- 基于视频的ERCP技能评估使用新型工具有可行性,并展示了良好的有效性证据。
- 未来步骤包括确定该工具能否区分不同经验水平的内镜医师并预测临床实践中的重要结局。
研究设计与样本
- 基于手术视频回顾,由专家小组将ERCP任务分解为基本组成部分,开发BESAT初始版本。
- 随后进行2轮改良德尔菲法和3次验证练习,以迭代优化工具。
- 采用完全交叉泛化性研究探讨评估者、ERCP操作和技术要素对信度的贡献。
主要发现
- 初步从任务分解中生成29个技术要素。
- 经迭代优化后,工具最终包含6个技术要素和11个子要素。
- 开发过程每次迭代均使工具性能特征获得持续改善。
- 最新版BESAT-v4的泛化系数(信度指数)为0.67。
- BESAT评分中大部分方差(43.55%)归因于内镜医师技能差异,表明工具可基于视频分析可靠区分内镜医师。
关键数值与推荐
- BESAT-v4的泛化系数(信度指数)为0.67。
- BESAT评分中43.55%的方差归因于内镜医师技能差异。
临床怎么用
- 原文未据此给出推荐。
局限性
- 未来步骤包括确定该工具能否区分不同经验水平的内镜医师并预测临床实践中的重要结局。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND AIMS: The accurate measurement of technical skill in ERCP is essential for endoscopic training, quality assurance, and coaching of this procedure. Hypothesizing that technical skill can be measured by analysis of ERCP videos, we aimed to develop and validate a video-based ERCP skill assessment tool. METHODS: Based on review of procedural videos, the task of ERCP was deconstructed into its basic components by an expert panel that developed an initial version of the Bethesda ERCP Skill Assessment Tool (BESAT). Subsequently, 2 modified Delphi panels and 3 validation exercises were conducted with the goal of iteratively refining the tool. Fully crossed generalizability studies investigated the contributions of assessors, ERCP performance, and technical elements to reliability. RESULTS: Twenty-nine technical elements were initially generated from task deconstruction. Ultimately, after iterative refinement, the tool comprised 6 technical elements and 11 subelements. The developmental process achieved consistent improvements in the performance characteristics of the tool with every iteration. For the most recent version of the tool, BESAT-v4, the generalizability coefficient (a reliability index) was .67. Most variance in BESAT scores (43.55%) was attributed to differences in endoscopists' skill, indicating that the tool can reliably differentiate between endoscopists based on video analysis. CONCLUSIONS: Video-based assessment of ERCP skill appears to be feasible with a novel instrument that demonstrates favorable validity evidence. Future steps include determining whether the tool can discriminate between endoscopists of varying experience levels and predict important outcomes in clinical practice.
引用
- Elmunzer BJ, Walsh CM, Guiton G, et al. Development and initial validation of an instrument for video-based assessment of technical skill in ERCP. Gastrointest Endosc. 2020. PMID: 32739484. doi:10.1016/j.gie.2020.07.055
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。