文献速递重症综合管理与镇静镇痛

评估用于测评ICU团队绩效的测量系统

Evaluation of a Measurement System to Assess ICU Team Performance.
PubMed 文献 · Crit Care Med · 2018-01-01
一句话结论在15张床外科ICU的138次团队协作观察中,该行为标记系统的评分者间信度总体良好至优秀(ICC 0.64–0.81),但部分具体能力条目信度仅为一般或差。

研究在外科ICU观察多学科查房、护士交接班和模拟抢救三种任务的团队协作,共138次观察(多学科查房88次、护士交接班25次、模拟抢救25次),由两名评分者评分。以组内相关系数评估评分者间信度,总体任务ICC为0.64–0.81,属良好至优秀,但7个具体能力条目信度为一般、1个为差。概化理论分析提示该标记系统能可靠区分不同团队协作能力,支持结构效度。作者认为该标记系统在区分能力方面潜力较大,但可能需要更多针对情境的指导以提高评分者信度。

要点

  • 在15张床外科ICU中,两名评分者对138次团队协作实例评分,总体任务ICC为0.64–0.81,信度良好至优秀。
  • 138次观察包括多学科查房88次、护士交接班25次、医学生与导师模拟抢救视频25次。
  • 7个具体能力条目的评分者信度仅为一般,1个具体能力条目信度为差。
  • 概化理论分析显示该标记系统能可靠区分团队协作能力,支持结构效度。
  • 作者认为该标记系统在区分能力方面潜力较大,但可能需要更多针对情境的指导以提高评分者信度。

适用人群与场景

  • 某大型学术医院15张床外科ICU的团队协作实例,包括多学科查房、护士对护士交接班及医学生与导师模拟抢救视频。

研究设计与关键结果

  • 研究为观察性测量系统评估,共观察138次团队协作实例:多学科查房88次、护士对护士交接班25次、模拟抢救练习25次;由两名评分者评分,未实施干预。
  • 各总体任务的评分者信度为良好至优秀(组内相关系数0.64–0.81),但7个具体能力条目信度为一般、1个具体能力条目信度为差。
  • 概化理论分析提示该标记系统能可靠区分团队协作能力,提供结构效度证据。

证据类型、等级与局限

  • 证据类型:观察性测量系统评估研究。
  • 局限:原文未报告局限性。

对床旁实践的改变

  • 作者认为该标记系统在区分团队协作能力方面潜力较大,但研究结果也提示可能需要更多针对情境的指导以提高评分者信度。

提炼说明

  • 本条依据论文摘要整理;摘要未涉及「诊断标准与关键阈值」「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开

OBJECTIVE: Measuring teamwork is essential in critical care, but limited observational measurement systems exist for this environment. The objective of this study was to evaluate the reliability and validity of a behavioral marker system for measuring teamwork in ICUs.

DESIGN: Instances of teamwork were observed by two raters for three tasks: multidisciplinary rounds, nurse-to-nurse handoffs, and retrospective videos of medical students and instructors performing simulated codes. Intraclass correlation coefficients were calculated to assess interrater reliability. Generalizability theory was applied to estimate systematic sources of variance for the three observed team tasks that were associated with instances of teamwork, rater effects, competency effects, and task effects.

SETTING: A 15-bed surgical ICU at a large academic hospital.

SUBJECTS: One hundred thirty-eight instances of teamwork were observed. Specifically, we observed 88 multidisciplinary rounds, 25 nurse-to-nurse handoffs, and 25 simulated code exercises.

INTERVENTIONS: No intervention was conducted for this study.

MEASUREMENTS AND MAIN RESULTS: Rater reliability for each overall task ranged from good to excellent correlation (intraclass correlation coefficient, 0.64-0.81), although there were seven cases where reliability was fair and one case where it was poor for specific competencies. Findings from generalizability studies provided evidence that the marker system dependably distinguished among teamwork competencies, providing evidence of construct validity.

CONCLUSIONS: Teamwork in critical care is complex, thereby complicating the judgment of behaviors. The marker system exhibited great potential for differentiating competencies, but findings also revealed that more context specific guidance may be needed to improve rater reliability.

来源:Crit Care Med,查看原文。版权归原作者所有。

参考来源

  1. Dietz AS, Salas E, Pronovost PJ, et al. Evaluation of a Measurement System to Assess ICU Team Performance. Crit Care Med. 2018. PMID: 30247242. doi:10.1097/CCM.0000000000003431

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。