超声引导靶向任务持续验证:内部结构评估
本研究在医学生中评估新型超声引导侵入性操作靶向任务的评分者间、评分者内和重测信度,训练组经四次每周1小时训练后成绩明显提高并维持数月,评分者间与评分者内ICC为0.83-0.93,重测ICC除一项指标外为0.50-0.78。
要点
- 超声引导靶向任务的评分者间与评分者内信度极好(ICC 0.83-0.93)。
- 重测信度除一项指标外为良好至极好(ICC 0.50-0.78)。
- 训练后任务完成表现明显改善并维持至少数月。
核心结论
- 医学生在靶向任务上的表现经训练后明显改善并持续数月,评分者间与评分者内信度极好,重测信度良好,为超声引导侵入性操作靶向课程提供了额外效度证据。
研究设计与样本
- 经机构审查委员会批准的非随机干预试验,一年级医学生先完成 dowel 和 straw 超声引导靶向任务作为前测,训练组随后接受四次每周1小时训练,对照组无进一步训练,两组后测,训练组在2个月和5个月后复评,记录完成时间(秒)、错误数和错误调整时间(每错误罚5秒)。
诊断标准与关键数值
- 评分者间和评分者内组内相关系数(ICC)极好,范围0.83-0.93;重测ICC除一项表现指标外为良好至极好,范围0.50-0.78。
临床应用与阅片要点
- 原文未据此给出推荐。
局限性
- 重测ICC在所有表现指标中除一项外为良好至极好(0.50-0.78),即有一项表现指标的重测信度未达良好至极好。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
RATIONALE AND OBJECTIVES: We previously demonstrated validity evidence for our novel ultrasound-guided invasive procedure targeting tasks in the content, response process, relations with other variables, and consequences validity domains. Here, we investigate their internal structure by assessing their interrater, intrarater, and test-retest reliability.
METHODS: In this Institutional Review Board approved nonrandomized interventional trial first year medical students performed our previously described dowel and straw ultrasound guidance targeting tasks as a pretest. Afterward, the training group had four weekly 1-hour training sessions. The control group had no further training. Both groups then had a posttest for both tasks. The training group was re-evaluated 2 and 5 months later. Completion time in seconds, errors, and error adjusted time (5 seconds penalty/error) were recorded. Pretest and posttest performance was compared within groups, and the amount of improvement from pretest to posttest was compared between groups. Interrater, intrarater, and test-retest interclass correlation coefficients (ICC) were calculated.
RESULTS: Although some improvements from pretest to posttest were seen in both groups, greater improvements were seen in the training group. This skill was retained for at least several months. The interrater and intrarater ICCs were excellent (range 0.83-0.93). The test-retest ICCs were good to excellent in all but one performance measure (0.50-0.78).
CONCLUSION: Student performance on the targeting tasks improved markedly after training and persisted for several months. The interrater and intrarater reliability were excellent, while the test-retest reliability was good. This provides additional validity evidence for our novel ultrasound-guided invasive procedure targeting curriculum.
引用
- Nitsche JF, Conrad S, Hoopes S, et al. Continued Validation of Ultrasound Guidance Targeting Tasks: Assessment of Internal Structure. Acad Radiol. 2018. PMID: 30316705. doi:10.1016/j.acra.2018.08.011
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。