文献速递神经肿瘤

基于机器学习的神经内镜垂体手术自动化工作流程分析:开发与临床前评估(IDEAL 0期)

Automated operative workflow analysis of endoscopic pituitary surgery using machine learning: development and preclinical evaluation (IDEAL stage 0).
PubMed 文献 · J Neurosurg · 2021-11-05

本研究为IDEAL 0期研究,使用Touch Surgery对50例神经内镜经蝶入路垂体腺瘤切除术视频进行手术阶段与步骤标注,40例用于训练卷积与循环神经网络联合模型,10例用于评估。模型识别手术阶段的准确率为91%、F1分数为90%,识别步骤的准确率为76%、F1分数为75%。作者认为该技术在教育、提高手术效率和改善患者结局方面有诸多潜在用途,未来方向包括将Touch Surgery实时整合到手术环境作为IDEAL 1期研究,并使用更大数据集进一步开发基础机器学习模型。

要点

  • 模型识别手术阶段准确率91%、F1分数90%,识别步骤准确率76%、F1分数75%。
  • 仅50%的视频包含全部7个步骤按数字顺序依次完成。
  • 最长阶段为蝶鞍阶段(中位28分钟),最长步骤为步骤5肿瘤识别与切除(中位17分钟)。

核心结论

  • 在这项IDEAL 0期研究中,机器学习技术被开发用于自动分析神经内镜经蝶入路垂体手术的手术视频。
  • 该技术此前已被证明可被神经外科团队和患者接受。
  • 基于机器学习的手术工作流程分析有诸多潜在用途,如教育(自动索引当代手术视频用于教学)、提高手术效率(协调整个手术团队遵循共同工作流程)和改善患者结局(比较手术技术或早期发现不良事件)。
  • 未来方向包括将Touch Surgery实时整合到手术环境作为IDEAL 1期(首次人体)研究,并使用更大数据集进一步开发基础机器学习模型。

研究设计与样本

  • IDEAL 0期研究,由专家外科医生对50例匿名神经内镜经蝶入路垂体腺瘤切除术手术视频的手术阶段和步骤进行标注。
  • 其中40例视频由Touch Surgery用于训练卷积与循环神经网络联合模型,10例视频用于模型评估,比较外科医生与机器学习模型对阶段和步骤的识别。

主要发现

  • 最长阶段为蝶鞍阶段(中位28分钟),其次为鼻阶段(中位22分钟)和关闭阶段(中位14分钟)。
  • 最长步骤为步骤5(肿瘤识别与切除,中位17分钟)、步骤3(后鼻中隔切除和蝶窦分隔去除,中位14分钟)和步骤4(前蝶鞍壁去除,中位10分钟)。
  • 录制手术在视频外观、步骤持续时间和步骤顺序方面存在较大变异,仅50%的视频包含全部7个步骤按数字顺序依次完成。
  • 模型能够准确识别手术阶段(准确率91%,F1分数90%)和步骤(准确率76%,F1分数75%)。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: Surgical workflow analysis involves systematically breaking down operations into key phases and steps. Automatic analysis of this workflow has potential uses for surgical training, preoperative planning, and outcome prediction. Recent advances in machine learning (ML) and computer vision have allowed accurate automated workflow analysis of operative videos. In this Idea, Development, Exploration, Assessment, Long-term study (IDEAL) stage 0 study, the authors sought to use Touch Surgery for the development and validation of an ML-powered analysis of phases and steps in the endoscopic transsphenoidal approach (eTSA) for pituitary adenoma resection, a first for neurosurgery. METHODS: The surgical phases and steps of 50 anonymized eTSA operative videos were labeled by expert surgeons. Forty videos were used to train a combined convolutional and recurrent neural network model by Touch Surgery. Ten videos were used for model evaluation (accuracy, F1 score), comparing the phase and step recognition of surgeons to the automatic detection of the ML model. RESULTS: The longest phase was the sellar phase (median 28 minutes), followed by the nasal phase (median 22 minutes) and the closure phase (median 14 minutes). The longest steps were step 5 (tumor identification and excision, median 17 minutes); step 3 (posterior septectomy and removal of sphenoid septations, median 14 minutes); and step 4 (anterior sellar wall removal, median 10 minutes). There were substantial variations within the recorded procedures in terms of video appearances, step duration, and step order, with only 50% of videos containing all 7 steps performed sequentially in numerical order. Despite this, the model was able to output accurate recognition of surgical phases (91% accuracy, 90% F1 score) and steps (76% accuracy, 75% F1 score). CONCLUSIONS: In this IDEAL stage 0 study, ML techniques have been developed to automatically analyze operative videos of eTSA pituitary surgery. This technology has previously been shown to be acceptable to neurosurgical teams and patients. ML-based surgical workflow analysis has numerous potential uses-such as education (e.g., automatic indexing of contemporary operative videos for teaching), improved operative efficiency (e.g., orchestrating the entire surgical team to a common workflow), and improved patient outcomes (e.g., comparison of surgical techniques or early detection of adverse events). Future directions include the real-time integration of Touch Surgery into the live operative environment as an IDEAL stage 1 (first-in-human) study, and further development of underpinning ML models using larger data sets.

来源:J Neurosurg,查看原文。版权归原作者所有。

引用

  1. Khan DZ, Luengo I, Barbarisi S, et al. Automated operative workflow analysis of endoscopic pituitary surgery using machine learning: development and preclinical evaluation (IDEAL stage 0). J Neurosurg. 2021. PMID: 34740198. doi:10.3171/2021.6.JNS21923

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。