解剖性肺切除手术能力评估工具(TCAT-ARC)的开发与初步测试
本研究开发并初步测试了用于评估胸外科受训者解剖性肺切除手术能力的工具TCAT-ARC。该工具通过多步骤流程开发,并在6个月临床研究中验证,7名受训者完成64例手术,显示高信度(α=0.93)和中等偏高观察者间信度(k=0.73)。工具与现有全局能力量表相关性中等偏高(k=0.68),受训者和评估者均认为其教育效果好且易用。
要点
- TCAT-ARC包含35个条目,在北美4个机构7名受训者中完成64例手术验证。
- 工具信度高(α=0.93),观察者间信度(k=0.73)和与全局能力量表相关性(k=0.68)中等偏高。
- 工具适用于培训早期,可提供形成性反馈和作为独立执业准备度综合评估的一部分。
核心结论
- TCAT-ARC在评估解剖性肺切除手术表现方面显示出初步的有效性和信度证据。
研究设计与样本
- 通过逻辑分析、专家评审、模拟和临床试点等多步骤开发工具,并进行6个月临床研究。
- 7名来自4个北美机构的受训者参与,共完成64例解剖性肺切除手术。
主要发现
- 工具信度高(α=0.93),观察者间信度(k=0.73)和与现有全局能力量表的相关性(k=0.68)中等偏高。
- 条目分析识别出最困难和最具区分度的条目,与肺切除概念理解吻合。
- 受训者和评估者均认为工具教育效果好且用户友好,执业外科医生表现优于受训者。
关键数值与推荐
- TCAT-ARC为35条目工具,信度α=0.93,观察者间信度k=0.73,与全局能力量表相关性k=0.68。
临床怎么用
- 可用于培训项目早期,提供关于步骤掌握情况的细粒度形成性反馈。
- 可作为受训者整体手术掌握度和独立执业准备度综合评估的一部分。
局限性
- 样本量较小(7名受训者),仅来自北美4个机构,需进一步验证。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: To meet the need for competency assessment in thoracic surgery education, we developed and tested an instrument to assess trainees' ability to perform anatomic lung resection for cancer. METHODS: The Thoracic Competency Assessment Tool-Anatomic Resection for Lung Cancer (TCAT-ARC) was developed through a multistep process involving logical analysis, expert review, and simulation-based and clinical pilot testing. Validity evidence was gathered during a 6-month clinical study of trainees performing anatomic lung resections and assessments of practicing surgeons. Feedback was gathered via post-encounter questionnaires. RESULTS: A 35-item instrument was developed and was tested in the clinical validation study. Seven trainees in 4 North American institutions participated and completed 64 anatomic lung resections. Reliability was high (α = 0.93). Interobserver reliability (k = 0.73) and correlation with an existing global competency scale (k = 0.68) were moderately high. Item analysis revealed the most difficult and discriminatory items, which matched well with a conceptual understanding of lung resection. Both trainees and assessors viewed the instrument as highly educationally effective and user-friendly. Practicing surgeons outperformed trainees. CONCLUSIONS: The TCAT-ARC demonstrated early evidence of validity and reliability in assessing performance of anatomic lung resection. The instrument may be most useful early in training and as a means for providing fine-grained formative feedback about which steps have been mastered and which still require improvement. The TCAT-ARC may be used in training programs to aid in the development of trainees' competency and as a part of an aggregate assessment of trainees' overall mastery of the procedure and readiness for independent practice.
引用
- Turner SR, Lai H, Nasir BS, et al. Development and Pilot Testing of an Assessment Tool for Performance of Anatomic Lung Resection. Ann Thorac Surg. 2019. PMID: 31706874. doi:10.1016/j.athoracsur.2019.09.052
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。