文献速递肾癌与肾肿瘤

吲哚菁绿驱动计算机视觉三维增强现实机器人辅助肾部分切除术:「自动」重叠时代的开端

Indocyanine Green Drives Computer Vision Based 3D Augmented Reality Robot Assisted Partial Nephrectomy: The Beginning of "Automatic" Overlapping Era.
PubMed 文献 · Urology · 2022-01-19

本研究初步探索了在增强现实机器人辅助肾部分切除术(AR-RAPN)中,利用计算机视觉和吲哚菁绿(ICG)近红外荧光成像实现三维虚拟模型自动重叠。共完成10例自动AR-RAPN,自动锚定平均用时7秒,7例完全内生或后侧病灶被正确识别并成功剜除,无Clavien>2并发症或切缘阳性。

要点

  • 开发IGNITE软件,利用ICG近红外荧光增强实现三维模型自动锚定。
  • 10例手术中自动锚定均成功,平均锚定时间7秒,无需手工辅助。
  • 7例完全内生或后侧病灶经自动AR正确识别并完成剜除。

核心结论

  • 本先导研究首次证明计算机视觉技术可自动完成三维模型与体内解剖的视觉匹配,用于AR手术。
  • 作者指出,术中肾脏变形影响自动锚定,将通过深度学习算法实现器官识别来克服这一局限。

研究设计与样本

  • 单臂先导研究,共完成10例自动AR-RAPN。
  • 利用计算机视觉策略,以整个肾脏为标志物,并采用近红外荧光(NIRF)Firefly荧光成像技术增强器官显影。

主要发现

  • 所有患者均制作高精度三维(HA3D)模型并在机器人控制台内以AR图像显示。
  • 全部手术过程中,自动ICG引导AR技术无需手工辅助成功将虚拟模型锚定至真实器官,平均锚定时间7秒,移动摄像头、缩放和移动器官时均保持锚定。
  • 7例完全内生或后侧病灶患者中,自动AR技术正确识别肾肿块并成功完成剜除。
  • 无术中或术后Clavien>2并发症,无切缘阳性记录。

临床怎么用

  • 原文未据此给出临床推荐。

局限性

  • 原文指出,术中肾脏变形会改变自动锚定,需通过深度学习算法实现器官识别来克服。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

Augmented reality robot-assisted partial nephrectomy (AR-RAPN) is limited by the need of a constant manual overlapping of the hyper-accuracy 3D (HA3D) virtual models to the real anatomy. To present our preliminary experience with automatic 3D virtual model overlapping during AR-RAPN. To reach a fully automated HA3D model overlapping, we pursued computer vision strategies, based on the identification of landmarks to link the virtual model. Due to the limited field of view of RAPN, we used the whole kidney as a marker. Moreover, to overcome the limit of similarity of colors between the kidney and its neighboring structures, we super-enhanced the organ, using the NIRF Firefly fluorescence imaging technology. A specifically developed software named "IGNITE" (Indocyanine GreeN automatIc augmenTed rEality) allowed the automatic anchorage of the HA3D model to the real organ, leveraging the enhanced view offered by NIRF technology. Ten automatic AR-RAPN were performed. For all the patients a HA3D model was produced and visualized as AR image inside the robotic console. During all the surgical procedures, the automatic ICG-guided AR technology successfully anchored the virtual model to the real organ without hand-assistance (mean anchorage time: 7 seconds), even when moving the camera throughout the operative field, while zooming and translating the organ. In 7 patients with totally endophytic or posterior lesions, the renal masses were correctly identified with automatic AR technology, performing a successful enucleoresection. No intraoperative or postoperative Clavien >2 complications or positive surgical margins were recorded. Our pilot study provides the first demonstration of the application of computer vision technology for AR procedures, with a software automatically performing a visual concordance during the overlap of 3D models and in vivo anatomy. Its actual limitations, related to the kidney deformations during surgery altering the automatic anchorage, will be overcome implementing the organ recognition with deep learning algorithms.

来源:Urology,查看原文。版权归原作者所有。

引用

  1. Amparore D, Checcucci E, Piazzolla P, et al. Indocyanine Green Drives Computer Vision Based 3D Augmented Reality Robot Assisted Partial Nephrectomy: The Beginning of "Automatic" Overlapping Era. Urology. 2022. PMID: 35063460. doi:10.1016/j.urology.2021.10.053

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。