标准化评估信竞争力共识的普适性:一项针对急诊医学教师全国样本的效度研究
本研究选取50份符合全国评分分布的新格式(2022 eSLOE 2.0)真实SLOE并匿名化,由25名来自不同人口学特征、地理区域和实践环境的教师按竞争力排序,用既定标准评估共识水平,并与既往结果比较(差异界值±10%)。结果显示,该多样化队列的教师共识略低于既往学术急诊医学教师研究,但无任何差异超过±10%界值;预测模型表现也与既往研究相似,仅在紧密一致水平上本研究的共识更强。学术机构教师的共识高于社区机构教师,且年限经验与更高共识不相关。结论认为,使用真实SLOE时竞争力共识程度在多样化全国样本中与既往小样本同质群体排名模拟SLOE的研究相似,点系统和回归模型均能以良好准确度预测共识排名。
要点
- 25名多样化急诊医学教师对50份真实2022 eSLOE 2.0按竞争力排序,共识水平与既往学术教师研究相似,无差异超过±10%界值。
- 在紧密一致水平上,本研究的共识强于既往结果;点系统和线性回归模型预测共识排名的准确度均良好。
- 学术机构教师的共识高于社区机构教师,年限经验与更高共识不相关。
- 该研究提示SLOE竞争力共识在更广泛教师群体中具有普适性,但差异均未超过预设的±10%界值。
适用人群与场景
- 25名急诊医学教师,代表不同人口学特征、地理区域和实践环境,用于对50份真实SLOE进行竞争力排序。
诊断标准与关键阈值
- 共识水平采用既往定义的 criteria 评估,并以±10%作为共识水平显著差异的界值。
研究设计与关键结果
- 研究选取50份符合全国评分分布的新格式(2022 eSLOE 2.0)真实SLOE并匿名化,由25名多样化教师按竞争力排序。
- 多样化队列的教师共识略低于既往学术急诊医学教师研究,但无任何差异超过±10%界值。
- 预测模型表现与既往研究相似,仅在紧密一致水平上本研究的共识强于既往结果。
- 学术机构教师的共识高于社区机构教师,年限经验与更高共识不相关。
证据类型、等级与局限
- 证据类型:效度研究(全国样本)。
- 局限:原文未报告局限性。
对床旁实践的改变
- 原文未据此给出推荐。
提炼说明
- 本条依据论文摘要整理;摘要未涉及「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开
BACKGROUND: Standardized letters of evaluation (SLOEs) are an important part of residency recruitment, particularly given the limited availability of other discerning factors in residency applications. While consensus regarding SLOE competitiveness has been studied within a small group of academic faculty, it remains unexplored how a more diverse group of letter readers interpret SLOEs in terms of competitiveness.
METHODS: A sample of 50 real SLOEs in the new SLOE format (2022 eSLOE 2.0) were selected to match the national rating distribution and anonymized. These SLOEs were ranked in order of competitiveness by 25 faculty members representing diverse demographics, geographic regions, and practice settings. Consensus levels were assessed using previously defined criteria and compared to prior results using a cutoff of ±10% to define a significant difference in consensus levels. Two models were tested to determine their ability to predict consensus rankings: a point-based system and a linear regression model.
RESULTS: Faculty consensus in this diverse cohort was slightly below the level measured among academic emergency medicine faculty in the prior study, though no differences were greater than the ±10% cutoff. Prediction models also performed similarly to a previous study except at the tight level of agreement, where consensus was stronger in this study compared to previous results. There is greater consensus among faculty at academic institutions than at community institutions, and years of experience was not correlated with higher consensus.
CONCLUSIONS: The degree of consensus regarding competitiveness using real SLOEs was similar in this diverse national sample compared to a prior study in a smaller and more homogenous group ranking mock SLOEs. Consensus ranks were predicted with good accuracy using both the point system and the regression model.
参考来源
- Bord S, Sehdev M, Pelletier-Bui A, et al. Generalizability of consensus regarding standardized letters of evaluation competitiveness: A validity study in a national sample of emergency medicine faculty. AEM Educ Train. 2024. PMID: 39664296. doi:10.1002/aet2.11049
供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。