文献速递胃肠外科围术期管理与 ERAS

TEsoNet:从腹腔镜袖状胃切除术到Ivor-Lewis食管切除术腹腔部分的手术阶段识别知识迁移

TEsoNet: knowledge transfer in surgical phase recognition from laparoscopic sleeve gastrectomy to the laparoscopic part of Ivor-Lewis esophagectomy.
PubMed 文献 · Surg Endosc · 2023-03-17

结果表明,即使目标手术训练数据量少,迁移学习仍可行,对手术流程重叠度高的阶段能达到合理准确率。

要点

  • 迁移学习可在目标手术数据有限时实现阶段识别。
  • 手术流程重叠度高的阶段迁移后准确率更合理。
  • 跨手术迁移学习有望提升数据效率。

核心结论

  • 通过迁移学习和协同训练,稳健的阶段识别模型能在目标手术训练数据量少时达到合理但阶段特异的准确率。

研究设计与样本

  • 将CNN+LSTM阶段识别模型适配为TEsoNet,探索不同训练集组成和训练权重下的迁移学习。

主要发现

  • 所探索的模型架构即使训练数据量少,也能在食管切除术等复杂手术中准确检测阶段。
  • 两个上消化道手术间的知识迁移可行,对手术流程重叠度高的阶段能达到合理准确率。

临床怎么用

  • 跨手术迁移学习可用于目标手术数据有限时的阶段识别模型开发。
  • 针对流程重叠度高的阶段,迁移学习可提升数据效率。

局限性

  • 尚需进一步探索确定成功迁移阶段识别所需的适当数据量、训练过程关键特征和时间标注方法。
  • 需探索罕见、专门手术的覆盖,以推动AI在术中风险缓解中的手术应用。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Surgical phase recognition using computer vision presents an essential requirement for artificial intelligence-assisted analysis of surgical workflow. Its performance is heavily dependent on large amounts of annotated video data, which remain a limited resource, especially concerning highly specialized procedures. Knowledge transfer from common to more complex procedures can promote data efficiency. Phase recognition models trained on large, readily available datasets may be extrapolated and transferred to smaller datasets of different procedures to improve generalizability. The conditions under which transfer learning is appropriate and feasible remain to be established. METHODS: We defined ten operative phases for the laparoscopic part of Ivor-Lewis Esophagectomy through expert consensus. A dataset of 40 videos was annotated accordingly. The knowledge transfer capability of an established model architecture for phase recognition (CNN + LSTM) was adapted to generate a "Transferal Esophagectomy Network" (TEsoNet) for co-training and transfer learning from laparoscopic Sleeve Gastrectomy to the laparoscopic part of Ivor-Lewis Esophagectomy, exploring different training set compositions and training weights. RESULTS: The explored model architecture is capable of accurate phase detection in complex procedures, such as Esophagectomy, even with low quantities of training data. Knowledge transfer between two upper gastrointestinal procedures is feasible and achieves reasonable accuracy with respect to operative phases with high procedural overlap. CONCLUSION: Robust phase recognition models can achieve reasonable yet phase-specific accuracy through transfer learning and co-training between two related procedures, even when exposed to small amounts of training data of the target procedure. Further exploration is required to determine appropriate data amounts, key characteristics of the training procedure and temporal annotation methods required for successful transferal phase recognition. Transfer learning across different procedures addressing small datasets may increase data efficiency. Finally, to enable the surgical application of AI for intraoperative risk mitigation, coverage of rare, specialized procedures needs to be explored.

来源:Surg Endosc,查看原文。版权归原作者所有。

引用

  1. Eckhoff JA, Ban Y, Rosman G, et al. TEsoNet: knowledge transfer in surgical phase recognition from laparoscopic sleeve gastrectomy to the laparoscopic part of Ivor-Lewis esophagectomy. Surg Endosc. 2023. PMID: 36932188. doi:10.1007/s00464-023-09971-2

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。