全分辨率模拟评估重症监护影像解读第一部分:固定效应识别检查类型、专科、疲劳和培训对住院医师表现的影响
本研究通过全分辨率DICOM模拟系统对47个项目的住院医师进行重症影像解读评分(0-10分),共分析2014-2018年5个年度992场65例8小时模拟的63,839个评分。结果显示27.0%评分为0-2分(临床显著漏诊),神经病例调整分较体部/骨肌病例低2.3分,8小时班次最后一小时评分降低0.3分,从R1中期至R3晚期培训效应为增加2.2分。
要点
- 神经病例调整评分较体部/骨肌病例低2.3分(CI 1.9-3.2),提示神经影像解读难度更高。
- 8小时班次最后一小时(第5五分位13/65例)评分降低0.3分(CI 0.20-0.38,p<0.0001),提示疲劳效应。
- 27.0%(CI 26.7%-27.4%)的评分为0-2分,即临床显著漏诊。
诊断标准与关键数值
- 评分范围0-10分,0-2分定义为临床显著漏诊,占19,916/63,839(27.0%,CI 26.7%-27.4%)。
- 神经病例调整评分较体部/骨肌病例低2.3分(CI 1.9-3.2)。
- 8小时班次最后一小时(第5五分位13/65例)评分降低0.3分(CI 0.20-0.38,p<0.0001)。
- 从R1中期(第3季度)至R3晚期(第12季度)培训效应为评分增加2.2分(CI 1.90-2.50)。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
RATIONALE AND OBJECTIVES: To describe our full-resolution simulation of critical care imaging coupled with posthoc grading of resident's interpretations and present results from the fixed effects terms in a comprehensive mixed regression model of the resulting scores.
MATERIALS AND METHODS: The system delivered full resolution DICOM studies via clinical-grade viewing software integrated with a custom built web-based workflow and reporting system. The interpretations submitted by participating residents from 47 different programs were graded (scores of 0-10) on a case by case basis by a cadre of faculty members from our department. The data from 5 yearly (2014-2018) cycles consisting of 992 separate 65 case, 8 hour simulation sessions were collated from the transaction records. We used a mixed (hierarchical) statistical model with nine fixed and four random independent variables. In this paper, we present the results from the nine fixed effects.
RESULTS: There were 19,916/63,839 (27.0%, CI 26.7%-27.4%) scores in the 0-2 range (i.e., clinically significant miss). Neurological cases were more difficult with adjusted scores 2.3 (CI 1.9-3.2) lower than body/musculoskeletal cases. There was a small (0.3, CI 0.20-0.38 points) but highly significant (p<0.0001) decrease in score for the final 13/65 cases (fifth quintile) as evidence of fatigue during the last hour of an 8 hour shift. By comparing adjusted scores from mid-R1 (quarter 3) to late-R3 (quarter 12) we estimate the training effect as an increase of 2.2 (CI 1.90-2.50) points.
CONCLUSION: Full resolution simulation based evaluation of critical care radiology interpretation is being conducted remotely and efficiently at large scale. Analysis of the resulting scores yields multiple insights into the interpretative process.
引用
- Sistrom CL, Slater RM, Rajderkar DA, et al. Full Resolution Simulation for Evaluation of Critical Care Imaging Interpretation; Part 1: Fixed Effects Identify Influences of Exam, Specialty, Fatigue, and Training on Resident Performance. Acad Radiol. 2020. PMID: 32376185. doi:10.1016/j.acra.2019.11.023
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。