EVAR操作能力评估:新型评分量表(EVARATE)在模拟环境中的有效性研究
本研究将55 mm肾下腹主动脉瘤的CT血管造影数据导入血管内模拟器,23名不同EVAR经验的医生完成标准EVAR操作并录像,由两名经验丰富的EVAR术者用新型量表EVARATE评估。EVARATE内部一致性高(Cronbach's alpha=0.90),评分者间信度可接受(ICC=0.68,p=0.005),特定EVAR经验与评分显著相关(Spearman's rho=0.62,p=0.002),能区分新手与中级(p<0.01)及专家(p<0.001),并采用对比组法确定及格/不及格分数。
要点
- EVARATE量表内部一致性高(Cronbach's alpha=0.90),评分者间信度可接受(ICC=0.68,p=0.005)。
- 特定EVAR经验与EVARATE评分显著相关(Spearman's rho=0.62,p=0.002),一般血管内经验则无显著相关。
- EVARATE能区分新手与中级(p<0.01)及专家(p<0.001),并采用对比组法确定及格/不及格分数。
核心结论
- 本文在模拟环境中对新型操作特定能力评估工具EVARATE用于血管内主动脉修复术者能力评估提供了初步有效性证据。
- 该评估工具可用于为受训者提供结构化的形成性反馈。
研究设计与样本
- 将直径55 mm肾下腹主动脉瘤的CT血管造影数据导入血管内模拟器。
- 23名具有不同EVAR经验的医生在模拟器上完成标准EVAR操作并录像。
- 两名经验丰富的EVAR术者使用新型评定量表「EndoVascular Aortic Repair Assessment of Technical Expertise」(EVARATE)对参与者进行评估。
- 依据美国教育研究协会认可的框架研究有效性。
主要发现
- EVARATE量表内部一致性高(Cronbach's alpha=0.90)。
- 评分者间信度可接受(组内相关系数=0.68,p=0.005)。
- 特定EVAR经验与EVARATE评分显著相关(Spearman's rho=0.62,p=0.002),但一般血管内经验与评分无显著相关。
- 后果分析显示EVARATE评估能区分新手与中级(p<0.01)及新手与专家(p<0.001)。
- 采用对比组法确定及格/不及格分数。
关键数值与推荐
- 内部一致性Cronbach's alpha=0.90。
- 评分者间信度组内相关系数=0.68(p=0.005)。
- 特定EVAR经验与EVARATE评分的Spearman's rho=0.62(p=0.002)。
- 新手与中级比较p<0.01,新手与专家比较p<0.001。
临床怎么用
- 作者指出该评估工具可用于为受训者提供结构化的形成性反馈。
局限性
- 本文报告的是在模拟环境中研究的初步有效性证据。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment. METHODS: Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, "EndoVascular Aortic Repair Assessment of Technical Expertise" (EVARATE). Validity was studied according to the framework endorsed by the American Educational Research Association. RESULTS: The EVARATE scale had a high internal consistency (Cronbach's alpha = .90). The inter-rater reliability was acceptable (Intraclass Correlation Coefficient = .68, p = .005). Specific EVAR experience correlated significantly with the EVARATE score (Spearman's rho = .62, p = .002), but general endovascular experience did not. Consequence analysis showed that the EVARATE assessment could distinguish novices from intermediates (p < .01) and from experts (p < .001). A pass/fail score was determined using the contrasting groups' method. CONCLUSION: This paper presents the initial validity evidence for a novel procedure specific assessment tool, EVARATE, for operator competence in endovascular aortic repair investigated in a simulated setting. The assessment tool can be used to provide structured formative feedback to trainees.
引用
- Strøm M, Lönn L, Konge L, et al. Assessment of EVAR Competence: Validity of a Novel Rating Scale (EVARATE) in a Simulated Setting. Eur J Vasc Endovasc Surg. 2018. PMID: 29628288. doi:10.1016/j.ejvs.2018.02.035
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。