产科与妇科超声技能模拟器评估:三种模拟器的效度及远程评估可行性
这项前瞻性研究纳入12名超声经验极少的医师,比较了现场与远程评估对其产科和妇科超声技能的评分,并比较三种模拟器与传统孕妇志愿者检查的评估结果。结果显示,远程与现场评估在20平面法图像评分上呈中至良好一致性,但OSAUS量表评分在所有站点均存在显著差异。受训者和评估者普遍认为模拟器对培训与评估有益。
要点
- 远程与现场评估在20平面法图像评分上呈中至良好一致性。
- 高保真人体模型模拟器的远程图像评分一致性较低。
- OSAUS量表远程与现场评分在所有站点均存在显著差异。
核心结论
- 模拟技术显示出评估妇产科超声能力的潜力。
- 由母胎医学认证专家进行远程评估可能是可行的。
- 模拟器作为远程评估超声技能方法的作用尚需进一步研究。
研究设计与样本
- 前瞻性研究,纳入12名妇产科超声经验极少的医师。
- 受训者完成结构化培训课程后在四个站点进行操作:一个为中孕期孕妇志愿者站点(仅产科检查),三个为模拟器站点(妇产科检查),分别为超声模拟器应用程序、高保真人体模型模拟器和光学定位模拟器。
- 每个站点由两名认证母胎医学专家同时评估,一名在现场,另一名通过实时视频远程观察。
- 评估基于国际妇产科超声学会基础培训项目的20平面法和超声技能客观结构化评估(OSAUS)量表。
- 采用匿名调查了解母胎医学专家和受训者对三种超声模拟器的主观印象。
主要发现
- 远程与现场评估使用20平面法的图像评分在四个站点中的三个显示中至良好一致性,组内相关系数(ICC)范围为0.51(95%CI,0.06-0.80)至0.89(95%CI,0.26-0.99)。
- 使用高保真人体模型模拟器获得的妇产科超声图像的远程评估评分低于现场评估,ICC为0.28(95%CI,-0.32至0.72)。
- OSAUS量表远程评分与现场评分在所有站点均存在显著差异(所有站点P < 0.05)。
- 使用20平面法,传统孕妇志愿者检查获得的产科图像评分与光学定位模拟器相似,但与其他两种模拟器不相似。
- 在现场评估者评估时,OSAUS评分仅在超声模拟器应用程序与高保真人体模型模拟器之间、以及光学定位模拟器与孕妇志愿者评估之间相似。
临床怎么用
- 模拟器可作为妇产科超声技能培训和评估的辅助工具。
- 远程评估在部分模拟器站点和20平面法图像评分上可行,但OSAUS量表远程评分与现场评分存在差异,需谨慎解读。
- 高保真人体模型模拟器的远程图像评估一致性较低,远程评估该模拟器图像时需注意。
局限性
- 样本量小(12名医师),可能限制结果的普遍性。
- 研究仅纳入经验极少的受训者,结果可能不适用于其他经验水平的医师。
- 远程评估与现场评估的差异机制未完全阐明,需进一步研究。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: The primary objective was to compare the evaluation of trainees' obstetric and gynecological (OBGYN) ultrasound skills by an in-person vs remote examiner. The secondary objectives were to compare the assessment of obstetric ultrasound skills using three types of ultrasound simulator vs traditional examination involving a pregnant volunteer, and to evaluate the perspectives of trainees and examiners on the three ultrasound simulators. METHODS: This was a prospective study of 12 physicians with minimal experience in OBGYN ultrasound. After completing a structured training course, trainees performed an ultrasound examination at four stations: one involving a mid-trimester pregnant volunteer (obstetric examination only) and three using ultrasound simulators (OBGYN examination), namely an ultrasound simulator app, a high-fidelity mannequin simulator and an optical positioning simulator. At each station, two certified maternal-fetal medicine specialists assessed the scans simultaneously, with one examiner present in the room and the other observing remotely via live video. The assessments were based on the 20-planes approach from the International Society of Ultrasound in Obstetrics and Gynecology Basic Training program and the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale. An anonymous survey was used to gauge the subjective impressions of the maternal-fetal medicine specialists and trainees on the three ultrasound simulators. RESULTS: The image scores from remote vs in-person assessment using the 20-planes approach showed moderate-to-good agreement across three of the four stations, with intraclass correlation coefficient (ICC) values ranging from 0.51 (95% CI, 0.06-0.80) to 0.89 (95% CI, 0.26-0.99). However, remote assessment of OBGYN ultrasound images obtained using the high-fidelity mannequin simulator yielded lower scores compared with in-person assessment, with an ICC of 0.28 (95% CI, -0.32 to 0.72). Additionally, scores on the OSAUS scale obtained remotely differed significantly from those obtained in person for all stations (P < 0.05 for all). Using the 20-planes approach, the obstetric image scores obtained during the traditional examination involving a pregnant volunteer were similar to those obtained using the optical positioning simulator, but not to those from the other two simulators. The OSAUS scores were similar only between the ultrasound simulator app and the high-fidelity mannequin simulator, and between the optical positioning simulator and assessment on a pregnant volunteer, when the assessment was conducted by an in-person examiner. Examiners and trainees generally agreed that ultrasound simulators offer benefit in the training and assessment of OBGYN ultrasound skills. CONCLUSIONS: Simulation-based techniques show potential for evaluating OBGYN ultrasound competence. It may be possible for evaluation to be conducted remotely by experts certified in maternal-fetal medicine. While promising as an educational and training tool, the role of simulation as a method for remotely assessing ultrasound skills warrants further investigation. © 2026 International Society of Ultrasound in Obstetrics and Gynecology.
引用
- Rameh G, Gallo DM, Corroenne R, et al. Simulator-based assessment of obstetric and gynecological ultrasound skills: validity of three different simulators and feasibility of remote evaluation. Ultrasound Obstet Gynecol. 2026. PMID: 41739883. doi:10.1002/uog.70175
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。