文献速递创伤骨科关节外科手外科与足踝外科

住院医师手术技能网络评估:两种评估工具的比较

Resident Surgical Skills Web-Based Evaluation: A Comparison of 2 Assessment Tools.
PubMed 文献 · J Bone Joint Surg Am · 2019-01-01

两种工具均能区分入门、中级与高级住院医师的能力差异,支持构建效度,超过70%教师认为两种工具均可区分能独立手术与需额外培训的住院医师。

要点

  • 两种网络评估工具在住院医师请求评估率或教师完成率上无显著差异。
  • O-score与P-score均能显示入门、中级与高级住院医师之间的能力显著差异。
  • 超过70%的教师认为使用P-score或O-score均可区分能独立手术与需额外培训的住院医师。

核心结论

  • 研究支持O-score与P-score评估方法的构建效度,并促使两种工具整合为OP-score。
  • ABOS设想OP-score可在不久的将来用于更多手术类型,并作为住院医师培训的必需元素。

研究设计与样本

  • 由美国骨科外科委员会(ABOS)与骨科住院医师主任委员会(CORD)开展的研究。
  • 16个骨科住院医师培训项目的294名住院医师由370名教师使用两种网络评估工具进行交叉设计评估。

主要发现

  • 住院医师请求评估率或教师完成两种评分率无显著差异。
  • 评估最多的手术为全膝关节置换术(n=254,11%)、腕管松解术(n=191,8%)、稳定髋部骨折切开复位内固定(ORIF)(n=170,7%)、简单踝关节骨折ORIF(n=169,7%)和全髋关节置换术(n=166,7%)。
  • 两种工具均显示入门、中级和高级住院医师之间的能力存在显著差异。
  • 调查结果显示超过70%的教师确信使用P-score或O-score能够区分能独立手术与需要额外培训的住院医师。

关键数值与推荐

  • O-Score包含9个问题,评估手术的8个步骤。
  • P-score为单一问题总结性评估。
  • 超过70%的教师对使用任一工具区分住院医师独立手术能力表示确信。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Evaluation of surgical skill competency is necessary as graduate medical education moves toward a competency-based curriculum. This study by the American Board of Orthopaedic Surgery (ABOS) and the Council of Orthopaedic Residency Directors (CORD) compares 2 web-based evaluation tools that assess the level of autonomy that is demonstrated by residents during surgical procedures in the operating room as measured by faculty. METHODS: Two hundred and ninety-four residents from 16 orthopaedic surgery residency programs were evaluated by 370 faculty using 2 web-based evaluation tools in a crossover design in which residents requested faculty review of their surgical skills before starting a case. One thousand, one hundred and fifty Ottawa Surgical Competency Operating Room Evaluation (O-Score) assessments, which included a 9-question evaluation of 8 steps of the surgical procedure, were compared with 1,186 P-score evaluations, which included a single-question summative evaluation. Twenty-five different surgical procedures were evaluated. RESULTS: There were no significant differences in rates of resident requests or faculty completion of the 2 scores. The most common surgical procedures that were assessed were total knee arthroplasty (n = 254, 11%), carpal tunnel release (n = 191, 8%), open reduction and internal fixation (ORIF) of stable hip fractures (n = 170, 7%), ORIF of simple ankle fractures (n = 169, 7%), and total hip arthroplasty (n = 166, 7%). Both instruments disclosed significant differences in competency among entry, intermediate, and advanced-level residents. The findings support the construct validity of the evaluation method. The survey results indicated that >70% of the faculty were confident that use of either the P-score or the O-score allowed them to distinguish a resident who can perform the surgery independently from one who needs additional training. CONCLUSIONS: This research has led to the modification of the O-score and the P-score into a combined OP-score instrument. The ABOS envisions that the OP-score instrument can be used with an expanded number of surgical procedures as a required element of residency training in the near future. CLINICAL RELEVANCE: This study allows the profession of orthopaedic surgery education to take a leadership role in the measurement of competence for surgical skills for orthopaedic surgeons in residency training, an important clinically relevant topic to the practice of orthopaedic surgery.

来源:J Bone Joint Surg Am,查看原文。版权归原作者所有。

引用

  1. Van Heest AE, Agel J, Ames SE, et al. Resident Surgical Skills Web-Based Evaluation: A Comparison of 2 Assessment Tools. J Bone Joint Surg Am. 2019. PMID: 30845044. doi:10.2106/JBJS.17.01512

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。