人工智能与计算机视觉分析机器人手术技术熟练度
本研究旨在设计并验证一种可解释的自动化方法,利用结直肠机器人手术视频和人工智能评估技术熟练度。92段腹膜关闭剪辑由6名外科医生按GEARS工具评分,并开发深度学习计算机视觉算法进行工具检测与追踪。结果显示,AI确定的工具总移动量与专家效率评分相关(r=-0.72),双手同时移动量与双手灵巧性评分相关(r=0.48),且高技能组工具移动显著更少、双手同时移动显著更多(p<0.001)。
要点
- AI提取的工具移动指标与专家GEARS评分显著相关
- 高技能外科医生腹膜关闭时工具移动更少
- AI计算机视觉有望标准化手术技术评估
核心结论
- AI算法提取的技术熟练度测量与专家外科医生评分相关,计算机视觉有望高效标准化手术技术评分。
研究设计与样本
- 研究纳入92段腹膜关闭剪辑,由6名委员会认证外科医生按GEARS工具评分,并开发深度学习计算机视觉算法进行手术工具检测与追踪。
主要发现
- GEARS效率类别中,专家技术效率评分与AI确定的工具总移动量呈正相关(r=-0.72)。
- 更熟练的外科医生进行腹膜关闭时工具移动显著少于较不熟练者(p<0.001)。
- GEARS双手灵巧性类别中,专家评分与AI基于同时工具移动计算的双手移动量呈正相关(r=0.48)。
- 高技能剪辑中双手同时移动显著多于低技能剪辑(p<0.001)。
临床怎么用
- AI计算机视觉可用于机器人手术技术熟练度的客观评估,辅助手术技能培训。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Intraoperative skills assessment is time-consuming and subjective; an efficient and objective computer vision-based approach for feedback is desired. In this work, we aim to design and validate an interpretable automated method to evaluate technical proficiency using colorectal robotic surgery videos with artificial intelligence. METHODS: 92 curated clips of peritoneal closure were characterized by both board-certified surgeons and a computer vision AI algorithm to compare the measures of surgical skill. For human ratings, six surgeons graded clips according to the GEARS assessment tool; for AI assessment, deep learning computer vision algorithms for surgical tool detection and tracking were developed and implemented. RESULTS: For the GEARS category of efficiency, we observe a positive correlation between human expert ratings of technical efficiency and AI-determined total tool movement (r = - 0.72). Additionally, we show that more proficient surgeons perform closure with significantly less tool movement compared to less proficient surgeons (p < 0.001). For the GEARS category of bimanual dexterity, a positive correlation between expert ratings of bimanual dexterity and the AI model's calculated measure of bimanual movement based on simultaneous tool movement (r = 0.48) was also observed. On average, we also find that higher skill clips have significantly more simultaneous movement in both hands compared to lower skill clips (p < 0.001). CONCLUSIONS: In this study, measurements of technical proficiency extracted from AI algorithms are shown to correlate with those given by expert surgeons. Although we target measurements of efficiency and bimanual dexterity, this work suggests that artificial intelligence through computer vision holds promise for efficiently standardizing grading of surgical technique, which may help in surgical skills training.
引用
- Yang JH, Goodman ED, Dawes AJ, et al. Using AI and computer vision to analyze technical proficiency in robotic surgery. Surg Endosc. 2022. PMID: 36536082. doi:10.1007/s00464-022-09781-y
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。