文献速递疝与腹壁外科围术期管理与 ERAS

将人工智能带入手术室:边缘计算用于实时手术阶段识别

Bringing Artificial Intelligence to the operating room: edge computing for real-time surgical phase recognition.
PubMed 文献 · Surg Endosc · 2023-08-14

该研究开发了基于ResNet-50的深度学习模型,用211段机器人腹股沟疝修补术视频训练并验证,部署于Nvidia Jetson Xavier NX边缘计算设备,在10例手术中实时识别手术阶段,平均准确率68.7%。

要点

  • 边缘计算设备可实时输出手术阶段预测,处理延迟约250毫秒。
  • 模型在10例机器人腹股沟疝修补术中实时测试,平均准确率68.7%。
  • 实时预测准确率范围为59.8%至78.2%。

核心结论

  • 基于计算机视觉深度学习模型的机器人腹股沟疝修补术实时阶段预测已成功实现。
  • 该实时计算机视觉阶段分割系统可用于监测手术进展,并可整合到软件中以优化医院工作流程。

研究设计与样本

  • 研究用211段机器人腹股沟疝修补术视频开发阶段识别算法,视频最初标注为14个手术阶段。
  • 使用上述视频训练和验证以ResNet-50为骨干的深度学习模型,并将模型部署到Nvidia Jetson Xavier NX边缘计算设备。
  • 模型在来自4位外科医生的10例腹股沟疝修补术中进行实时测试。

主要发现

  • 通过录制后处理方法(如将阶段合并为7个最终阶段:腹膜评分、补片放置、腹膜前分离、疝还纳、体外、腹膜关闭和过渡空闲,以及帧平均)改进了模型。
  • 预测每秒生成一次,处理延迟约250毫秒。
  • 实时预测准确率范围为59.8%至78.2%,平均准确率为68.7%。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Automation of surgical phase recognition is a key effort toward the development of Computer Vision (CV) algorithms, for workflow optimization and video-based assessment. CV is a form of Artificial Intelligence (AI) that allows interpretation of images through a deep learning (DL)-based algorithm. The improvements in Graphic Processing Unit (GPU) computing devices allow researchers to apply these algorithms for recognition of content in videos in real-time. Edge computing, where data is collected, analyzed, and acted upon in close proximity to the collection source, is essential meet the demands of workflow optimization by providing real-time algorithm application. We implemented a real-time phase recognition workflow and demonstrated its performance on 10 Robotic Inguinal Hernia Repairs (RIHR) to obtain phase predictions during the procedure. METHODS: Our phase recognition algorithm was developed with 211 videos of RIHR originally annotated into 14 surgical phases. Using these videos, a DL model with a ResNet-50 backbone was trained and validated to automatically recognize surgical phases. The model was deployed to a GPU, the Nvidia® Jetson Xavier™ NX edge computing device. RESULTS: This model was tested on 10 inguinal hernia repairs from four surgeons in real-time. The model was improved using post-recording processing methods such as phase merging into seven final phases (peritoneal scoring, mesh placement, preperitoneal dissection, reduction of hernia, out of body, peritoneal closure, and transitionary idle) and averaging of frames. Predictions were made once per second with a processing latency of approximately 250 ms. The accuracy of the real-time predictions ranged from 59.8 to 78.2% with an average accuracy of 68.7%. CONCLUSION: A real-time phase prediction of RIHR using a CV deep learning model was successfully implemented. This real-time CV phase segmentation system can be useful for monitoring surgical progress and be integrated into software to provide hospital workflow optimization.

来源:Surg Endosc,查看原文。版权归原作者所有。

引用

  1. Choksi S, Szot S, Zang C, et al. Bringing Artificial Intelligence to the operating room: edge computing for real-time surgical phase recognition. Surg Endosc. 2023. PMID: 37580578. doi:10.1007/s00464-023-10322-4

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。