腹腔镜良性食管裂孔手术操作技能评估的系统综述
本系统综述检索至2017年7月,纳入1084条引文,最终识别6种用于评估腹腔镜良性前肠与食管裂孔手术(LFS)操作技能的工具。仅1种工具有中等强度效度证据,其余效度有限或未知,尚不足以支持基于视频的高利害终结性评估。
要点
- 共识别6种评估工具,2种为腹腔镜通用,4种为LFS专用。
- 仅1种工具有中等证据支持,其余效度证据有限或未知。
- 效度证据主要基于内部结构(信度与条目分析)和内容,反应过程、与其他变量关系及后果证据少。
核心结论
- 支持腹腔镜前肠手术评估工具效度的证据有限,妨碍其用于基于视频的终结性能力验证。
- 需要进一步研究开发专门用于该目的的评估工具。
研究设计与样本
- 系统综述,检索截至2017年7月,两名独立评价者筛选1084条引文。
- 纳入报告腹腔镜良性前肠与食管裂孔手术(LFS)术中操作评估工具数据的研究。
- 记录每种评估工具的特征和测试条件,采用五种效度来源评估效度证据。
主要发现
- 共识别6种独立工具:2种腹腔镜通用工具,4种LFS专用工具(2种针对Nissen胃底折叠术,1种针对Heller肌切开术,1种针对食管裂孔疝修补术)。
- 仅1种评估有中等证据支持,其余效度证据有限或未知。
- 效度证据主要基于内部结构(所有工具报告信度和条目分析)和内容(2项研究引用既往文献支持工具开发,4项仅列出条目未说明开发过程)。
- 反应过程证据少(1项研究报告评分者培训),与其他变量关系证据少(2项研究比较不同临床经验受试者的评分),后果证据无研究。
- 有2种工具具备视频评估证据,均针对Nissen胃底折叠术。
临床怎么用
- 现有工具尚不能用于基于视频的终结性能力验证,临床应谨慎解读评估结果。
- 可优先关注有中等效度证据的工具,但需结合具体术式选择。
局限性
- 检索截止2017年7月,可能遗漏后续研究。
- 效度证据在反应过程、与其他变量关系及后果方面明显不足。
- 多数工具开发过程未详细报告,内容效度证据有限。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Operative skills correlate with patient outcomes, yet at the completion of training or after learning a new procedure, these skills are rarely formally evaluated. There is interest in the use of summative video assessment of laparoscopic benign foregut and hiatal surgery (LFS). If this is to be used to determine competency, it must meet the robust criteria established for high-stakes assessments. The purpose of this review is to identify tools that have been used to assess performance of LFS and evaluate the available validity evidence for each instrument. METHODS: A systematic search was conducted up to July 2017. Eligible studies reported data on tools used to assess performance in the operating room during LFS. Two independent reviewers considered 1084 citations for eligibility. The characteristics and testing conditions of each assessment tool were recorded. Validity evidence was evaluated using five sources of validity (content, response process, internal structure, relationship to other variables, and consequences). RESULTS: There were six separate tools identified. Two tools were generic to laparoscopy, and four were specific to LFS [two specific to Nissen fundoplication (NF), one heller myotomy (HM), and one paraesophageal hernia repair (PEH)]. Overall, only one assessment was supported by moderate evidence while the others had limited or unknown evidence. Validity evidence was based mainly on internal structure (all tools reporting reliability and item analysis) and content (two studies referencing previous papers for tool development in the context of clinical assessment, and four listing items without specifying the development procedures). There was little or no evidence supporting test response process (one study reporting rater training), relationship to other variables (two comparing scores in subjects with different clinical experience), and consequences (no studies). Two tools were identified to have evidence for video assessment, specific to NF. CONCLUSION: There is limited evidence supporting the validity of assessment tools for laparoscopic foregut surgery. This precludes their use for summative video-based assessment to verify competency. Further research is needed to develop an assessment tool designed for this purpose.
引用
- Bilgic E, Al Mahroos M, Landry T, et al. Assessment of surgical performance of laparoscopic benign hiatal surgery: a systematic review. Surg Endosc. 2019. PMID: 30671670. doi:10.1007/s00464-019-06662-9
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。