评估评估者:C-SATS平台能否胜任?
多机构队列研究纳入48名外科医生,提交机器人辅助胆囊切除和/或腹股沟疝修补术视频,用C-SATS平台的GEARS评分评估,并与历史手术量做相关分析。结果显示总体GEARS评分与手术量正相关,但在住院医/研究员及手术量<50例者中无相关性,且无法区分新手与专家。
要点
- C-SATS的GEARS总分与机器人胆囊切除和疝修补的历史手术量正相关。
- 在住院医/研究员及手术量<50例的医生中,GEARS评分与手术量无相关性。
- GEARS评分无法区分新手与专家,各领域和手术步骤评分组间无差异。
核心结论
- C-SATS衍生的GEARS评分与机器人胆囊切除和腹股沟疝修补的总体医生历史手术量相关。
- 该评分在新手执行者中与手术量无相关性,且无法区分新手与专家。
- 需要高保真且更具区分度的机器人技能评估平台用于培训者和新手外科医生。
研究设计与样本
- 多机构队列研究,48名外科医生(高年资住院医、研究员和执业医师)提交机器人胆囊切除和/或腹股沟疝修补的代表性视频。
- 受试者随后使用C-SATS平台进行盲法病例视频回顾,该平台采用GEARS评估表。
- 参与外科医生自我报告手术病例量。
主要发现
- 总体GEARS评分与历史病例量在机器人胆囊切除(r=0.65,p<0.0001)和腹股沟疝修补(r=0.54,p=0.001)中均呈正相关。
- 亚组分析中,住院医/研究员无相关性(机器人胆囊切除r=0.39,p=0.11;腹股沟疝修补r=0.22,p=0.49)。
- 历史病例量<50例者无相关性(机器人胆囊切除r=0.14,p=0.55;腹股沟疝修补r=0.21,p=0.54)。
- 住院医/研究员与执业医师的总GEARS评分无差异(机器人胆囊切除20.21 vs 20.25,p=0.82;腹股沟疝修补20.45 vs 20.46,p=0.95)。
- 历史病例量<50与≥50例者的总GEARS评分无差异(机器人胆囊切除20.16 vs 20.33,p=0.33;腹股沟疝修补20.35 vs 20.49,p=0.48)。
关键数值与推荐
- GEARS各领域(双手灵巧性、深度知觉、效率、力敏感性和机器人控制)及手术步骤评分在两组间相似(p>0.05)。
临床怎么用
- C-SATS的GEARS评分可用于评估有经验医生的机器人手术熟练度与病例量的关系。
- 对于培训中的住院医/研究员或手术量<50例的新手,该平台无法区分熟练度,需结合其他评估方法。
局限性
- 研究样本量较小(48名外科医生),可能影响亚组分析的统计效能。
- 手术病例量为自我报告,可能存在回忆偏倚。
- 平台无法区分新手与专家,提示其区分度有限。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: Robotic-assisted surgery has increased in prevalence, particularly in general surgery. The number of cases required to achieve adequate proficiency in robotic surgery, however, and the training metrics that correlate best with proficiency remain unclear. We sought to better define proficiency-based benchmarks in robotic-assisted cholecystectomies (RAC) and inguinal hernia repairs (RIHR) using a commercial crowd source based on competency platform. METHODS: Multi-institutional cohort study in which 48 surgeons (senior residents, fellows, and practicing physicians) submitted representative videos of themselves performing a RAC and/or RIHR. Subjects subsequently underwent blinded case video reviews using the C-SATS platform, which utilizes the Global Evaluative Assessment of Robotic Skills (GEARS) rubric. Participating surgeons self-reported surgical case volume. Primary outcome was correlation of GEARS scores with historic procedure case volume. Secondary outcomes included construct validity of GEARS scores as an operative proficiency metric. RESULTS: Total GEARS scores and historical case volume showed positive correlation for both RAC (r = 0.65, p < 0.0001) and RIHR (r = 0.54, p = 0.001) among all performers. On subgroup analysis, no correlation was seen for resident/fellow physicians (r = 0.39, p = 0.11 for RAC; r = 0.22, p = 0.49 for RIHR) or those with < 50 historic case volume (r = 0.14, p = 0.55 for RAC; r = 0.21, p = 0.54 for RIHR). No difference in total GEARS scores was seen between resident/fellow and practicing physicians for either RAC (20.21 v 20.25, p = 0.82) or RIHR (20.45 v 20.46, p = 0.95), nor in those with < 50 or ≥ 50 historic case volume in RAC (20.16 v 20.33, p = 0.33) and RIHR (20.35 v 20.49, p = 0.48). GEARS scores by domain (bimanual dexterity, depth perception, efficiency, force sensitivity, and robotic control) and surgical step (exposure of triangle of calot, clipping and division of cystic artery/duct, and dissection of gallbladder; mobilizing peritoneal flap, hernia sac dissection, and mesh placement) were similar across both groups (p > 0.05). CONCLUSION: C-SATS-derived GEARS scores correlated to overall surgeon historical case volume for RA cholecystectomy and IHR, but not among novice performers. This methodology was unable to differentiate between novice and expert performers for these procedures. There remains a need for high-fidelity and discerning robotic skills evaluation platforms for trainees and novice surgeons.
引用
- Laverty RB, Chesnut CH, Karam JR, et al. Evaluating the evaluators: does C-SATS measure up? Surg Endosc. 2025. PMID: 40954374. doi:10.1007/s00464-025-12150-0
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。