开发基于理论考试的超声造影核心能力评估工具并收集效度证据
本研究通过德尔菲流程开发了基于多项选择题的超声造影核心能力理论测试,并对不同经验医生施测以收集效度证据。最终47题测试能区分有无超声造影经验的操作者,信度可接受,但及格/不及格分数存在假阳性和假阴性风险,不推荐用于认证。
要点
- 47题理论测试可区分有无超声造影经验的操作者,信度可接受。
- 测试的及格/不及格分数存在相当程度的假阳性和假阴性风险。
- 该测试可能用于学习超声造影实践能力前的入门测试,不推荐用于认证。
核心结论
- 47题理论测试能区分有无超声造影经验的操作者且信度可接受,但及格/不及格分数存在假阳性和假阴性风险,不推荐用于认证。
研究设计与样本
- 通过德尔菲流程由专家组开发基于多项选择题的理论测试,对具有不同超声造影经验的医生施测,依据Messick框架收集效度证据。
诊断标准与关键数值
- 最终测试包含47道测试题。
- 测试能区分有和无超声造影经验的操作者,信度可接受。
- 及格/不及格分数导致相当程度的假阳性和假阴性风险。
临床应用与阅片要点
- 该测试可能用作学习超声造影实践能力前的入门测试。
- 该测试不推荐用于认证目的,因为存在假阳性和假阴性风险。
局限性
- 及格/不及格分数导致相当程度的假阳性和假阴性风险。
- 测试不推荐用于认证目的,因为存在假阳性和假阴性风险。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Contrast-enhanced ultrasound (CEUS) is an imaging modality applied in a broad field of medical specialties for diagnostic uses, guidance during biopsy procedures and ablation therapies and sonoporation therapy. Appropriate training and assessment of theoretical and practical competencies are recommended before practicing CEUS, but no validated assessment tools exist. This study was aimed at developing a theoretical multiple-choice question-based test for core CEUS competencies and gathering validity evidence for the test. An expert team developed the test via a Delphi process. The test was administered to medical doctors with varying CEUS experience, and the results were used to evaluate test items, internal-consistency reliability, ability to distinguish between different proficiency levels and to establish a pass/fail score. Validity evidence was gathered according to Messick's framework. The final test with 47 test items could distinguish between operators with and without CEUS experience with acceptable reliability. The pass/fail score led to considerable risk of false positives and negatives. The test may be used as an entry test before learning practical CEUS competencies but is not recommended for certification purposes because of the risk of false positives and negatives.
引用
- Jacobsen, Nolsøe, Konge, et al. Development of and Gathering Validity Evidence for a Theoretical Test in Contrast-Enhanced Ultrasound. Ultrasound Med Biol. 2021. PMID: 34815128. doi:10.1016/j.ultrasmedbio.2021.10.016
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。