经验对临床结肠镜操作能力自我评估准确性的影响
本研究纳入来自5家医院的20名新手、10名中级和10名经验丰富的内镜医师,各自完成一次临床结肠镜操作,视频由2名盲法专家用GiECAT评估,并与自我评估比较。外部评估与自我评估的组内相关系数为0.65(95%CI 0.44-0.80),三组绝对差值评分有显著差异(P=.002),经验丰富者自我评估准确性优于新手(P=.002)。
要点
- 外部评估与自我评估的组内相关系数为0.65(95%CI 0.44-0.80),一致性为中等。
- 三组绝对差值评分有显著差异(P=.002),经验丰富者自我评估准确性优于新手(P=.002)。
- Bland-Altman分析提示新手倾向于高估自身临床能力,经验丰富者倾向于低估。
核心结论
- 参与者对临床能力的自我评估准确性为中等。
- 内镜医师经验与自我评估准确性呈正相关,新手自我评估准确性低于经验丰富者。
- 新手倾向于高估自身表现。
- 作者认为新手内镜医师可能受益于针对性干预以提高自我评估准确性。
研究设计与样本
- 研究纳入来自5家医院的新手(既往完成<50例结肠镜)、中级(50-500例)和经验丰富(>1000例)内镜医师,每人完成一次临床结肠镜操作。
- 操作视频由2名盲法专家内镜医师使用胃肠内镜能力评估工具(GiECAT)独立评估,外部评估GiECAT评分为2个视频评分的均值,自我评估GiECAT评分为参与者自己给出的评分。
- 自我评估准确性通过绝对差值评分、组内相关系数和Bland-Altman分析评估。
主要发现
- 共20名新手、10名中级和10名经验丰富内镜医师参与。
- 外部评估与自我评估GiECAT评分的组内相关系数为0.65(95%CI 0.44-0.80),一致性为中等。
- 三组绝对差值评分有显著差异(P=.002),经验丰富内镜医师自我评估准确性优于新手(P=.002)。
- Bland-Altman图提示新手倾向于高估自身临床能力,经验丰富者倾向于低估自身临床能力,中级者未显示特定趋势。
临床怎么用
- 作者认为新手内镜医师可能受益于针对性干预以提高自我评估准确性。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND AIMS: Self-assessment is important for life-long learning and a recommended assessment method for endoscopy skills. Prior literature has not investigated self-assessment accuracy of colonoscopic competence in the clinical setting. This study aimed to determine the self-assessment accuracy of novice, intermediate, and experienced endoscopists. METHODS: Novice (performed <50 previous colonoscopies), intermediate (50-500), and experienced (>1000) endoscopists from 5 hospitals each performed a clinical colonoscopy. Video recordings of procedures were independently assessed by 2 blinded expert endoscopists by using the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT). Externally assessed and self-assessed GiECAT scores were defined as the mean of the 2 video-based ratings and as participants' own assigned ratings, respectively. Self-assessment accuracy between the externally assessed and self-assessed scores was evaluated by using absolute difference scores, intraclass correlation coefficients, and the Bland-Altman analysis. RESULTS: Twenty novice, 10 intermediate, and 10 experienced endoscopists participated. There was moderate agreement of externally assessed and self-assessed GiECAT scores, with an intraclass correlation coefficient of 0.65 (95% confidence interval, 0.44-0.80). The absolute difference scores among the 3 groups were significantly different (P = .002), with experienced endoscopists demonstrating a more accurate self-assessment ability compared with novices (P = .002). Bland-Altman plots suggest that novice and experienced endoscopists tend to overrate and underrate their clinical competence, respectively; no specific trends were associated with intermediates. CONCLUSION: Participants demonstrated moderate self-assessment accuracy of clinical competence. Endoscopist experience was positively associated with self-assessment accuracy; novices demonstrated lower self-assessment accuracy compared with experienced endoscopists. Moreover, novices tended to overestimate their performances. Novice endoscopists may benefit from targeted interventions to improve self-assessment accuracy.
引用
- Scaffidi MA, Grover SC, Carnahan H, et al. Impact of experience on self-assessment accuracy of clinical colonoscopy competence. Gastrointest Endosc. 2017. PMID: 29122599. doi:10.1016/j.gie.2017.10.040
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。