两种肌肉骨骼超声能力评估工具具有坚实的效度证据:一项效度研究
本研究让30名不同肌肉骨骼超声经验的医师对同一名类风湿关节炎患者进行四个关节区域的检查,视频由两名盲法评估者分别用OSAUS和EULAR工具评分。两种工具评分者间信度均高(皮尔逊相关系数分别为0.807和0.848),且与经验水平强线性相关(R²分别为0.897和0.868),能显著区分不同经验水平(P < 0.001)。
要点
- OSAUS与EULAR工具评分者间信度均高,皮尔逊相关系数分别为0.807和0.848。
- 两工具与经验水平强线性相关,R²分别为0.897和0.868,且能显著区分经验水平(P < 0.001)。
- EULAR工具在评分者间信度上优于OSAUS,两种工具均可可靠有效评估肌肉骨骼超声操作能力。
核心结论
- 肌肉骨骼超声操作者能力可用OSAUS或EULAR评估工具可靠且有效地评估,从而有望在未来实现统一的基于能力的肌肉骨骼超声教育。
- 尽管两种工具均显示高评分者间信度,但EULAR工具优于OSAUS。
研究设计与样本
- 30名具有不同肌肉骨骼超声经验水平(新手、中级和熟练)的医师对同一名类风湿关节炎患者进行四个不同关节区域的肌肉骨骼超声检查。
- 所有检查均录像(n = 120),匿名后由两名盲法评估者按随机顺序先用OSAUS评估工具、1个月后用EULAR工具进行评估。
主要发现
- 两名评估者间的评分者间信度对OSAUS和EULAR工具均高,皮尔逊相关系数分别为0.807和0.848。
- 两种工具均表现出极好的病例间信度,OSAUS的Cronbach's alpha为0.970,EULAR为0.964。
- OSAUS和EULAR表现评分与参与者经验水平之间存在强线性相关(R²分别为0.897和0.868),且对不同肌肉骨骼超声经验水平有显著区分(两者P < 0.001)。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Musculoskeletal ultrasound (MSUS) is increasingly used by rheumatologists in daily clinical practice. However, MSUS is only valuable in trained hands, and assessment of trainee competences is therefore essential before independent practice. Thus, this study aimed to establish validity evidence for the EULAR and the Objective Structured Assessment of Ultrasound Skills (OSAUS) tools used for assessing MSUS competences. METHODS: Thirty physicians with different levels of MSUS experience (novices, intermediates, and experienced) performed four MSUS examinations of different joint areas on the same rheumatoid arthritis patient. All examinations were video recorded (n = 120), anonymized, and subsequently assessed in random order by two blinded raters using first the OSAUS assessment tool followed by the EULAR tool 1 month after. RESULTS: The inter-rater reliability between the two raters was high for both the OSAUS and EULAR tools, with a Pearson correlation coefficient (PCC) of 0.807 and 0.848, respectively. Both tools demonstrated excellent inter-case reliability, with a Cronbach's alpha of 0.970 for OSAUS and 0.964 for EULAR. Furthermore, there was a strong linear correlation between the OSAUS and the EULAR performance scores and the participants' experience levels (R2 = 0.897 and R2 = 0.868, respectively) and a significant discrimination between different MSUS experience levels (P < 0.001 for both). CONCLUSIONS: MSUS operator competences can be assessed reliably and valid using either the OSAUS or the EULAR assessment tool, thereby allowing a uniform competency-based MSUS education in the future. Although both tools demonstrated high inter-rater reliability, the EULAR tool was superior to OSAUS. TRIAL REGISTRATION: ClinicalTrials.gov, http://clinicaltrials.gov, NCT05256355.
引用
- Carstensen SMD, Just SA, Pfeiffer-Jensen M, et al. Solid validity evidence for two tools assessing competences in musculoskeletal ultrasound: a validity study. Rheumatology (Oxford). 2024. PMID: 37307078. doi:10.1093/rheumatology/kead286
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。