文献速递胃肠外科围术期管理与 ERAS

基于YOLOv3的腹腔镜胃切除术手术器械自动检测系统

Automated Surgical Instrument Detection from Laparoscopic Gastrectomy Video Images Using an Open Source Convolutional Neural Network Platform.
PubMed 文献 · J Am Coll Surg · 2020-03-07

本研究基于开源神经网络平台YOLOv3开发腹腔镜胃切除术视频的手术器械检测系统,采用52例手术的10716张图像进行20万次迭代训练。测试集精确率0.87、敏感度0.83,生成的热图可高正确率反映吻合方式、十二指肠与胃游离起始时间及是否出现非常规操作。

要点

  • 测试集器械检测精确率0.87、敏感度0.83
  • 热图可免看视频识别吻合方式与操作时间点,正确率≥90%
  • 系统有望提升手术视频复盘与评估效率

核心结论

  • 基于YOLOv3的自动器械检测系统在腹腔镜胃切除术视频中开发并验证成功。
  • 热图可替代直接观看视频,帮助术者识别手术关键特征。

研究设计与样本

  • 从52例腹腔镜胃切除术视频提取10716张图像用于训练与验证,训练迭代200000次。
  • 另取10例独立腹腔镜胃切除术视频由系统分析并绘制器械使用趋势热图,由3名熟练外科医生评价。

主要发现

  • 训练后测试集精确率0.87,敏感度(召回率)0.83。
  • 热图完全呈现各手术所用器械。
  • 术者不看视频仅凭热图即准确识别吻合类型、十二指肠与胃游离起始时间及是否行非常规操作,正确率≥90%。

关键数值与推荐

  • 测试集精确率0.87,敏感度(召回率)0.83。
  • 术者依据热图判断的正确答案率≥90%。
  • 训练迭代次数为200000次。

临床怎么用

  • 可用于腹腔镜胃切除术视频的自动复盘与手术技能评估,减少人工审阅视频的时间。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: The common use of laparoscopic intervention produces impressive amounts of video data that are difficult to review for surgeons wishing to evaluate and improve their skills. Therefore, a need exists for the development of computer-based analysis of laparoscopic video to accelerate surgical training and assessment. We developed a surgical instrument detection system for video recordings of laparoscopic gastrectomy procedures. This system, the use of which might increase the efficiency of the video reviewing process, is based on the open source neural network platform, YOLOv3. STUDY DESIGN: A total of 10,716 images extracted from 52 laparoscopic gastrectomy videos were included in the training and validation data sets. We performed 200,000 iterations of training. Video recordings of 10 laparoscopic gastrectomies, independent of the training and validation data set, were analyzed by our system, and heat maps visualizing trends of surgical instrument usage were drawn. Three skilled surgeons evaluated whether each heat map represented the features of the corresponding operation. RESULTS: After training, the testing data set precision and sensitivity (recall) was 0.87 and 0.83, respectively. The heat maps perfectly represented the devices used during each operation. Without reviewing the video recordings, the surgeons accurately recognized the type of anastomosis, time taken to initiate duodenal and gastric dissection, and whether any irregular procedure was performed, from the heat maps (correct answer rates ≥ 90%). CONCLUSIONS: A new automated system to detect manipulation of surgical instruments in video recordings of laparoscopic gastrectomies based on the open source neural network platform, YOLOv3, was developed and validated successfully.

来源:J Am Coll Surg,查看原文。版权归原作者所有。

引用

  1. Yamazaki Y, Kanaji S, Matsuda T, et al. Automated Surgical Instrument Detection from Laparoscopic Gastrectomy Video Images Using an Open Source Convolutional Neural Network Platform. J Am Coll Surg. 2020. PMID: 32156655. doi:10.1016/j.jamcollsurg.2020.01.037

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。