文献速递胃肠外科围术期管理与 ERAS

基于CNN深度学习在腹腔镜乙状结肠切除术中实时自动识别手术阶段

Real-time automatic surgical phase recognition in laparoscopic sigmoidectomy using the convolutional neural network-based deep learning approach.
PubMed 文献 · Surg Endosc · 2019-12-03

本研究基于71例腹腔镜乙状结肠切除术(Lap-S)视频,将每例手术手动划分为11个手术阶段(Phase 0-10),并逐帧标注手术动作,利用卷积神经网络(CNN)深度学习构建模型,在未见测试集上验证。结果显示自动手术阶段识别准确率为91.9%,体外动作和冲洗的自动识别准确率分别为89.4%和82.5%,系统能以32 fps实时识别手术阶段。

要点

  • CNN模型对Lap-S手术阶段识别准确率达91.9%。
  • 体外动作与冲洗识别准确率分别为89.4%和82.5%。
  • 系统实现32 fps实时手术阶段识别。

核心结论

  • 基于CNN的深度学习可利用手动标注数据识别Lap-S的手术阶段和动作。
  • 该系统能以高准确率自动识别手术阶段和目标手术动作。
  • 研究证实了高帧率实时自动手术阶段识别的可行性。

研究设计与样本

  • 研究使用71例Lap-S病例的视频数据,每1/30秒拆分为静态帧图像。
  • 每例Lap-S视频被手动划分为11个手术阶段(Phase 0-10),并逐帧标注手术动作。
  • 模型基于训练数据生成,并在未见测试集上验证,采用基于CNN的深度学习。

主要发现

  • 平均手术时间为175分钟(±43分钟SD),各手术阶段时长在病例间变异大。
  • 每台手术均从Phase 0开始、Phase 10结束,平均发生14次(±2 SD)阶段转换。
  • 自动手术阶段识别准确率为91.9%,体外动作和冲洗的自动识别准确率分别为89.4%和82.5%。
  • 系统能以32 fps进行实时自动手术阶段识别。

临床怎么用

  • 该技术可为开发情境感知计算机辅助手术系统提供基础。
  • 实时阶段识别可能有助于术中流程监控与反馈。

局限性

  • 研究仅纳入71例Lap-S病例,样本量有限。
  • 手术阶段与动作标注依赖人工,可能存在主观差异。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Automatic surgical workflow recognition is a key component for developing the context-aware computer-assisted surgery (CA-CAS) systems. However, automatic surgical phase recognition focused on colorectal surgery has not been reported. We aimed to develop a deep learning model for automatic surgical phase recognition based on laparoscopic sigmoidectomy (Lap-S) videos, which could be used for real-time phase recognition, and to clarify the accuracies of the automatic surgical phase and action recognitions using visual information. METHODS: The dataset used contained 71 cases of Lap-S. The video data were divided into frame units every 1/30 s as static images. Every Lap-S video was manually divided into 11 surgical phases (Phases 0-10) and manually annotated for each surgical action on every frame. The model was generated based on the training data. Validation of the model was performed on a set of unseen test data. Convolutional neural network (CNN)-based deep learning was also used. RESULTS: The average surgical time was 175 min (± 43 min SD), with the individual surgical phases also showing high variations in the duration between cases. Each surgery started in the first phase (Phase 0) and ended in the last phase (Phase 10), and phase transitions occurred 14 (± 2 SD) times per procedure on an average. The accuracy of the automatic surgical phase recognition was 91.9% and those for the automatic surgical action recognition of extracorporeal action and irrigation were 89.4% and 82.5%, respectively. Moreover, this system could perform real-time automatic surgical phase recognition at 32 fps. CONCLUSIONS: The CNN-based deep learning approach enabled the recognition of surgical phases and actions in 71 Lap-S cases based on manually annotated data. This system could perform automatic surgical phase recognition and automatic target surgical action recognition with high accuracy. Moreover, this study showed the feasibility of real-time automatic surgical phase recognition with high frame rate.

来源:Surg Endosc,查看原文。版权归原作者所有。

引用

  1. Kitaguchi D, Takeshita N, Matsuzaki H, et al. Real-time automatic surgical phase recognition in laparoscopic sigmoidectomy using the convolutional neural network-based deep learning approach. Surg Endosc. 2019. PMID: 31797047. doi:10.1007/s00464-019-07281-0

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。