文献速递复苏、休克与脓毒症创伤与烧伤

REBOA操作技能评估工具REBOA-RATE的信效度验证

Reliable and valid assessment of procedural skills in resuscitative endovascular balloon occlusion of the aorta.
PubMed 文献 · J Trauma Acute Care Surg · 2021-01-01
一句话结论REBOA-RATE工具信效度高,单评分者即可可靠评估REBOA操作技能,81%为及格线,可区分新手、麻醉医生和血管内专家。

三名临床专家使用REBOA-RATE独立盲评视频。结果显示工具内部一致性高(Cronbach's α=0.95),评分者间信度优(ICC=0.97);单评分者评3次操作即可达到高利害测试可靠性(G系数>0.80)。三组第二次操作平均分分别为新手32%、麻醉医生55%、血管内专家93%(p<0.001),及格线设为81%,所有专家通过而新手均未通过。结论支持REBOA-RATE用于基于胜任力的培训和认证。

要点

  • REBOA-RATE评分者间信度ICC=0.97,内部一致性Cronbach's α=0.95,单评分者评3次操作即可满足高利害测试可靠性(G系数>0.80)。
  • 工具可区分经验水平:第二次操作平均分新手32%、麻醉医生55%、血管内专家93%(p<0.001)。
  • 及格/不及格标准设为81%,所有血管内专家通过,所有新手未通过。
  • 评估基于院外心脏骤停模拟场景中REBOA操作视频,盲法随机评分,工具所需指导极少。
  • 证据等级为诊断性试验,无或差金标准,level V。

适用人群与场景

  • 研究为模拟场景,非真实临床环境;原文未提及排除标准。

诊断标准与关键阈值

  • 使用REBOA-RATE工具评估REBOA操作技能,及格/不及格标准设为81%。
  • 可靠性标准:单评分者评3次操作可使G系数>0.80,适合高利害测试。
  • 原文未提及REBOA操作的临床适应证或禁忌证标准。

处置流程与药物剂量

  • 原文未提及具体REBOA操作步骤或药物剂量。
  • 评估流程:操作视频录制→盲法随机→三名临床专家独立使用REBOA-RATE评分。

红旗征与不能漏的情况

  • 原文未提及

研究设计与关键结果

  • 内部一致性Cronbach's α=0.95;评分者间信度ICC=0.97;单评分者评3次操作G系数>0.80。
  • 第二次操作平均分(SD):新手32%(24%)、麻醉医生55%(29%)、血管内专家93%(4%),p<0.001。
  • 及格线81%,所有专家通过,所有新手未通过。

证据类型、等级与局限

  • 诊断性试验,无或差金标准,证据等级level V。

对床旁实践的改变

  • REBOA-RATE可用于评估REBOA操作技能,支持基于胜任力的培训和认证;单评分者评3次操作即可可靠评估,工具所需指导极少。
  • 适用人群为接受REBOA操作培训的医生;原文未提及不适用人群。
  • 注意:研究为模拟场景,及格线81%基于该模拟环境数据,需结合真实临床场景验证。

指南或共识出处

  • 原文未提及

以上提炼依据论文摘要(全文未开放获取,或许可不允许翻译转载);全文请点「阅读原文」。

英文原文(摘要)· 点击展开

BACKGROUND: Valid and reliable assessment of skills is essential for improved and evidence-based training concepts. In a recent study, we presented a novel tool to assess procedural skills in resuscitative endovascular balloon occlusion of the aorta (REBOA), REBOA-RATE, based on international expert consensus. Although expert consensus is a strong foundation, the performance of REBOA-RATE has not been explored. The study aimed to examine the reliability and validity of REBOA-RATE.

METHODS: This was an experimental simulation-based study. We enrolled doctors with three levels of expertise to perform two REBOA procedures in a simulated scenario of out-of-hospital cardiac arrest. Procedures were video-recorded, and videos were blinded and randomized. Three clinical experts independently rated all procedures using REBOA-RATE. Data were analyzed using Messick's framework for validity evidence, including generalizability analysis of reliability and determination of a pass/fail standard.

RESULTS: Forty-two doctors were enrolled: 16 novices, 13 anesthesiologists, and 13 endovascular experts. They all performed two procedures, yielding 84 procedures and 252 ratings. The REBOA-RATE assessment tool showed high internal consistency (Cronbach's α = 0.95) and excellent interrater reliability (intraclass correlation coefficient, 0.97). Assessment using one rater and three procedures could ensure overall reliability suitable for high-stakes testing (G-coefficient >0.80). Mean scores (SD) for the three groups in the second procedure were as follows: novices, 32% (24%); anesthesiologists, 55% (29%); endovascular experts, 93% (4%) (p < 0.001). The pass/fail standard was set at 81%, which all experts but no novices passed.

CONCLUSION: Data strongly support the reliability and validity of REBOA-RATE, which successfully discriminated between all experience levels. The REBOA-RATE assessment tool requires minimal instruction, and one rater is sufficient for reliable assessment. Together, these are strong arguments for the use of REBOA-RATE to assess REBOA skills, allowing for competency-based training and certification concepts.

LEVEL OF EVIDENCE: Diagnostic test, no or poor gold standard, level V.

来源:J Trauma Acute Care Surg,查看原文。版权归原作者所有。

参考来源

  1. Engberg M, Lönn L, Konge L, et al. Reliable and valid assessment of procedural skills in resuscitative endovascular balloon occlusion of the aorta. J Trauma Acute Care Surg. 2021. PMID: 34225347. doi:10.1097/TA.0000000000003338

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。