文献速递腹部技术与安全US

开发一种可靠的基于模拟的腹部超声诊断测试,并制定可用于掌握学习的通过/未通过标准

Development of a reliable simulation-based test for diagnostic abdominal ultrasound with a pass/fail standard usable for mastery learning.
PubMed 文献 · Eur Radiol · 2017-07-04

本研究基于模拟器开发腹部诊断超声测试,纳入15例患者共44项表现,按经验分四组,由两名盲法评估者评分。项目分析剔除14项诊断后,内部一致性(Cronbach's alpha 0.96)与评分者间信度(0.99)良好,经验与得分显著相关(Pearson's r=0.82, p<0.001),通过/未通过标准无假阳性或假阴性。

要点

  • 该模拟测试内部一致性(Cronbach's alpha 0.96)和评分者间信度(0.99)良好。
  • 经验与测试得分显著相关(Pearson's r=0.82, p<0.001)。
  • 通过/未通过标准无假阳性或假阴性,可用于掌握学习。

核心结论

  • 开发出具有可靠效度证据的腹部诊断超声测试及无假阳性或假阴性的通过/未通过标准。

研究设计与样本

  • 基于模拟器的测试开发研究;模拟器含150例真实患者腹部扫描,选取15例共44项表现(代表欧洲超声医学与生物学联合会一级水平);四组经验水平:新手(医学生)、受训者(第一年放射科住院医师)、中级(第三至四年放射科住院医师)、高级(超声专科医师);标准化测试,两名盲法评估者评分,先行项目分析。

诊断标准与关键数值

  • 项目分析剔除14项诊断;内部一致性Cronbach's alpha 0.96;评分者间信度0.99;组间差异显著(p<0.001),但中级与高级组间无显著差异(p=1.0);经验与测试得分Pearson's r=0.82(p<0.001);通过/未通过标准使所有新手未通过(无假阳性)、所有高级通过(无假阴性);所有中级和14名受训者中6名通过。

临床应用与阅片要点

  • 作者认为该测试适用于能力本位教育(如掌握学习),可区分超声检查者的能力水平。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

BACKGROUND: This study aimed to develop a test with validity evidence for abdominal diagnostic ultrasound with a pass/fail-standard to facilitate mastery learning.

METHOD: The simulator had 150 real-life patient abdominal scans of which 15 cases with 44 findings were selected, representing level 1 from The European Federation of Societies for Ultrasound in Medicine and Biology. Four groups of experience levels were constructed: Novices (medical students), trainees (first-year radiology residents), intermediates (third- to fourth-year radiology residents) and advanced (physicians with ultrasound fellowship). Participants were tested in a standardized setup and scored by two blinded reviewers prior to an item analysis.

RESULTS: The item analysis excluded 14 diagnoses. Both internal consistency (Cronbach's alpha 0.96) and inter-rater reliability (0.99) were good and there were statistically significant differences (p < 0.001) between all four groups, except the intermediate and advanced groups (p = 1.0). There was a statistically significant correlation between experience and test scores (Pearson's r = 0.82, p < 0.001). The pass/fail-standard failed all novices (no false positives) and passed all advanced (no false negatives). All intermediate participants and six out of 14 trainees passed.

CONCLUSION: We developed a test for diagnostic abdominal ultrasound with solid validity evidence and a pass/fail-standard without any false-positive or false-negative scores.

KEY POINTS: • Ultrasound training can benefit from competency-based education based on reliable tests. • This simulation-based test can differentiate between competency levels of ultrasound examiners. • This test is suitable for competency-based education, e.g. mastery learning. • We provide a pass/fail standard without false-negative or false-positive scores.

来源:Eur Radiol,查看原文。版权归原作者所有。

引用

  1. Østergaard ML, Nielsen KR, Albrecht-Beste E, et al. Development of a reliable simulation-based test for diagnostic abdominal ultrasound with a pass/fail standard usable for mastery learning. Eur Radiol. 2017. PMID: 28677051. doi:10.1007/s00330-017-4913-x

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。