结肠镜检查操作表现的现场评估与视频评估的前瞻性比较
本研究纳入5家医院40名内镜医师(20名新手、10名中级、10名经验丰富者),比较结肠镜检查的现场评估与基于视频的盲法评估。结果显示两种评估一致性良好(总分ICC=0.847),视频评估的评估者内信度优秀(ICC=0.99)、评估者间信度较高(ICC=0.91),GiECAT总分、GRS和CL评分在不同经验组间差异显著(P<.001);视频评估被认为「相当容易」,但现场评估被评定为显著更容易(P<.001)。
要点
- 现场与视频评估一致性良好(总分ICC=0.847,GRS ICC=0.868,CL ICC=0.749)
- 视频评估评估者内信度优秀(ICC=0.99),两名盲法评估者间信度较高(ICC=0.91)
- GiECAT总分、GRS、CL评分在新手、中级、经验丰富组间差异显著(P<.001)
核心结论
- 使用GiECAT对结肠镜操作进行视频评估具有较强信度和效度证据,视频评估可行,但现场评估更容易。
研究设计与样本
- 前瞻性比较研究,纳入5家医院40名内镜医师(20名新手<50例、10名中级50-500例、10名经验丰富>1000例既往结肠镜)。
- 每次结肠镜录制内镜(腔内)视野和操作者手部动作两个视角,由2名盲法专家独立用GiECAT(含GRS和CL)评估,并与1名非盲法专家现场评估比较。
主要发现
- 现场与视频评估一致性良好:总分ICC=0.847,GRS ICC=0.868,CL ICC=0.749。
- 视频评估评估者内信度优秀:总分ICC=0.99,GRS ICC=0.99,CL ICC=0.98。
- 两名盲法视频评估者间信度较高:总分ICC=0.91,GRS ICC=0.918,CL ICC=0.862。
- GiECAT总分、GRS和CL评分在新手、中级和经验丰富内镜医师间差异显著(P<.001)。
- 视频评估被认为「相当容易」,但现场评估被评定为显著更容易(P<.001)。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND AIMS: Colonoscopy performance is typically assessed by a supervisor in the clinical setting. There are limitations of this approach, however, because it allows for rater bias and increases supervisor workload demand during the procedure. Video-based assessment of recorded procedures has been proposed as a complementary means by which to assess colonoscopy performance. This study sought to investigate the reliability, validity, and feasibility of video-based assessments of competence in performing colonoscopy compared with live assessment. METHODS: Novice (<50 previous colonoscopies), intermediate (50-500), and experienced (>1000) endoscopists from 5 hospitals participated. Two views of each colonoscopy were videotaped: an endoscopic (intraluminal) view and a recording of the endoscopist's hand movements. Recorded procedures were independently assessed by 2 blinded experts using the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT), a validated procedure-specific assessment tool comprising a global rating scale (GRS) and checklist (CL). Live ratings were conducted by a non-blinded expert endoscopist. Outcomes included agreement between live and blinded video-based ratings of clinical colonoscopies, intra-rater reliability, inter-rater reliability and discriminative validity of video-based assessments, and perceived ease of assessment. RESULTS: Forty endoscopists participated (20 novices, 10 intermediates, and 10 experienced). There was good agreement between the live and video-based ratings (total, intra-class correlation [ICC] = 0.847; GRS, ICC = 0.868; CL, ICC = 0.749). Intra-rater reliability was excellent (total, ICC = 0.99; GRS, ICC = 0.99; CL, ICC = 0.98). Inter-rater reliability between the 2 blinded video-based raters was high (total, ICC = 0.91; GRS, ICC = 0.918; CL, ICC = 0.862). GiECAT total, GRS, and CL scores differed significantly among novice, intermediate, and experienced endoscopists (P < .001). Video-based assessments were perceived as "fairly easy," although live assessments were rated as significantly easier (P < .001). CONCLUSIONS: Video-based assessments of colonoscopy procedures using the GiECAT have strong evidence of reliability and validity. In addition, assessments using videos were feasible, although live assessments were easier.
引用
- Scaffidi MA, Grover SC, Carnahan H, et al. A prospective comparison of live and video-based assessments of colonoscopy performance. Gastrointest Endosc. 2017. PMID: 28859953. doi:10.1016/j.gie.2017.08.020
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。