文献速递创伤与烧伤消化、代谢与肾脏急症

头戴摄像机视频记录可评估创伤核心 competency 手术的技术表现,效果不劣于现场评估者

Head-camera video recordings of trauma core competency procedures can evaluate surgical resident's technical performance as well as colocated evaluators.
PubMed 文献 · J Trauma Acute Care Surg · 2017-01-01
一句话结论对腋动脉、股动脉暴露及筋膜切开术,头戴摄像机视频结合个体手术评分可无偏、有效地评估住院医师技术表现,与现场评估者结果一致。

研究在新鲜尸体上对40名PGY-2至PGY-6住院医师的腋动脉、肱动脉、股动脉血管暴露及下肢筋膜切开术进行头戴摄像机录像,比较现场评估者与盲法视频评估者的个体手术评分(IPS)。结果显示腋动脉、股动脉、筋膜切开术的IPS在两种评估方式间无差异(p≥0.5),错误识别完全一致(p=1.0),组内相关系数0.73-0.92,视频与现场评估相关性0.5-0.9;除肱动脉外,盲法视频评估者可区分培训前后(p<0.002)。结论认为视频评估无偏、有效,有潜力用于形成性评估。

要点

  • 对腋动脉、股动脉暴露及筋膜切开术,现场与视频评估的IPS无差异(p≥0.5),视频评估可替代现场评估。
  • 视频与现场评估者错误识别完全一致(p=1.0),组内相关系数0.73-0.92,相关性0.5-0.9。
  • 除肱动脉外,盲法视频评估可区分培训前后(p<0.002),提示视频IPS能反映培训效果。
  • 评估者一致性为0.29(肱动脉)至0.77(股动脉),肱动脉评估一致性较低。
  • 研究为预后研究,证据等级II级,方法学质量评分15.5/19,偏倚风险低。

适用人群与场景

  • 40名PGY-2至PGY-6住院医师,在新鲜尸体上操作腋动脉、肱动脉、股动脉血管暴露及下肢筋膜切开术。
  • 培训前按IPS三分位每组随机选1名外科医生(共12名)进行盲法视频复核,培训后4周内重复录像。

诊断标准与关键阈值

  • 采用个体手术评分(IPS)评估血管暴露和筋膜切开术表现技能。
  • IPS为先前验证的评分工具,用于评估腋动脉、肱动脉、股动脉暴露及下肢筋膜切开术操作技能。

研究设计与关键结果

  • 40名PGY-2至PGY-6住院医师在新鲜尸体上完成腋动脉、肱动脉、股动脉暴露及下肢筋膜切开术,头戴摄像机录像。
  • 2名现场培训评估者在培训前后评估IPS;每项手术按培训前IPS三分位随机选1名外科医生(共12名)进行盲法视频复核,培训后4周内重复录像。
  • 5名评估者独立复核全部96段随机排列的去标识视频。
  • 腋动脉、股动脉、筋膜切开术的IPS在現場与视频评估间无差异(p≥0.5)。
  • 评估者一致性为0.29(肱动脉)至0.77(股动脉)。
  • 视频与现场评估者对错误识别完全一致(p=1.0)。
  • 组内相关系数为0.73至0.92,取决于手术类型;视频与现场评估相关性为0.5至0.9。
  • 除肱动脉外,盲法视频评估者可区分培训前与培训后(p<0.002)。

证据类型、等级与局限

  • 预后研究,证据等级II级。
  • 方法学质量采用医学教育研究质量工具(Medical Education Research Study Quality Instrument)评分为15.5/19。
  • 采用诊断准确性研究质量评价工具(Quality Assessment of Diagnostic Accuracy Studies 2)显示偏倚风险低。
  • 局限:原文未报告局限性。

对床旁实践的改变

  • 作者认为,采用IPS对腋动脉、股动脉和筋膜切开术进行视频评估是无偏、有效的,有潜力用于能力形成性评估。
  • 视频评估与现场评估在腋动脉、股动脉、筋膜切开术的IPS和错误识别上结果一致,除肱动脉外可区分培训前后。

提炼说明

  • 本条依据论文摘要整理;摘要未涉及「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开

BACKGROUND: Unbiased evaluation of trauma core competency procedures is necessary to determine if residency and predeployment training courses are useful. We tested whether a previously validated individual procedure score (IPS) for individual procedure vascular exposure and fasciotomy (FAS) performance skills could discriminate training status by comparing IPS of evaluators colocated with surgeons to blind video evaluations.

METHODS: Performance of axillary artery (AA), brachial artery (BA), and femoral artery (FA) vascular exposures and lower extremity FAS on fresh cadavers by 40 PGY-2 to PGY-6 residents was video-recorded from head-mounted cameras. Two colocated trained evaluators assessed IPS before and after training. One surgeon in each pretraining tertile of IPS for each procedure was randomly identified for blind video review. The same 12 surgeons were video-recorded repeating the procedures less than 4 weeks after training. Five evaluators independently reviewed all 96 randomly arranged deidentified videos. Inter-rater reliability/consistency, intraclass correlation coefficients were compared by colocated versus video review of IPS, and errors. Study methodology and bias were judged by Medical Education Research Study Quality Instrument and the Quality Assessment of Diagnostic Accuracy Studies criteria.

RESULTS: There were no differences (p ≥ 0.5) in IPS for AA, FA, FAS, whether evaluators were colocated or reviewed video recordings. Evaluator consistency was 0.29 (BA) - 0.77 (FA). Video and colocated evaluators were in total agreement (p = 1.0) for error recognition. Intraclass correlation coefficient was 0.73 to 0.92, dependent on procedure. Correlations video versus colocated evaluations were 0.5 to 0.9. Except for BA, blinded video evaluators discriminated (p < 0.002) whether procedures were performed before training versus after training. Study methodology by Medical Education Research Study Quality Instrument criteria scored 15.5/19, Quality Assessment of Diagnostic Accuracy Studies 2 showed low bias risk.

CONCLUSION: Video evaluations of AA, FA, and FAS procedures with IPS are unbiased, valid, and have potential for formative assessments of competency.

LEVEL OF EVIDENCE: Prognostic study, level II.

来源:J Trauma Acute Care Surg,查看原文。版权归原作者所有。

参考来源

  1. Mackenzie CF, Pasley J, Garofalo E, et al. Head-camera video recordings of trauma core competency procedures can evaluate surgical resident's technical performance as well as colocated evaluators. J Trauma Acute Care Surg. 2017. PMID: 28376020. doi:10.1097/TA.0000000000001467

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。