文献速递消化内镜消化道肿瘤与早癌

比较2种人工智能计算机辅助检测系统假激活数量与相关性的NOISE研究

Comparing the number and relevance of false activations between 2 artificial intelligence computer-aided detection systems: the NOISE study.
PubMed 文献 · Gastrointest Endosc · 2022-01-04

在Humanitas Research Hospital收集的两组各40段视频中,比较两种已获批计算机辅助检测系统(CADe A与CADe B)的假阳性激活。CADe A共记录1021次假激活(每例结肠镜25.5±12.2次),CADe B共1028次(25.7±13.2次;P=.53)。采用标准化命名分类后,两种系统结果可比。

要点

  • CADe A每例结肠镜假激活25.5±12.2次,CADe B为25.7±13.2次,差异无统计学意义(P=.53)。
  • 肠壁伪影所致假激活在CADe A为22.9±9.9次(89.8%),CADe B为22.1±10.0次(86.0%)。
  • 肠内容物所致假激活在CADe A为2.6±1.9次(10.2%),CADe B为3.5±2.1次(14%),P=.45。

核心结论

  • 使用标准化命名分类(NOISE分类)后,两种近期获批的CADe系统在假激活数量和相关性方面结果可比。

研究设计与样本

  • 在Humanitas Research Hospital收集两组连续视频库(每组40段视频),分别比较两种不同品牌的CADe系统(CADe A和CADe B)。
  • 对每段视频记录CADe假激活次数、原因及内镜医师检查错误高亮区域所花时间,并按既往开发的NOISE分类对假激活的原因和相关程度进行分类。
  • 临床试验注册号:NCT04399590。

主要发现

  • CADe A在40段视频中共记录1021次假阳性激活(每例结肠镜25.5±12.2次),CADe B共识别1028次(每例结肠镜25.7±13.2次;P=.53)。
  • CADe A中肠壁伪影所致假激活为22.9±9.9次(89.8%),CADe B为22.1±10.0次(86.0%)。
  • CADe A中肠内容物所致假激活为2.6±1.9次(10.2%),CADe B为3.5±2.1次(14%)(P=.45)。
  • CADe A每次假激活需0.2±0.9秒,每例结肠镜有1.6±1.0次假激活(6.3%)需额外时间进行内镜评估。
  • CADe B每次假激活需0.2±0.8秒,每例结肠镜有1.8±1.2次假激活需额外检查。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND AND AIMS: Artificial intelligence has been shown to be effective in polyp detection, and multiple computer-aided detection (CADe) systems have been developed. False-positive (FP) activation emerged as a possible way to benchmark CADe performance in clinical practice. The aim of this study was to validate a previously developed classification of FPs comparing the performances of different brands of approved CADe systems. METHODS: We compared 2 different consecutive video libraries (40 video per arm) collected at Humanitas Research Hospital with 2 different CADe system brands (CADe A and CADe B). For each video, the number of CADe false activations, cause, and time spent by the endoscopist to examine the area erroneously highlighted were reported. The FP activations were classified according to the previously developed classification of FPs (the NOISE classification) according to their cause and relevance. RESULTS: In CADe A 1021 FP activations were registered across the 40 videos (25.5 ± 12.2 FPs per colonoscopy), whereas in CADe B 1028 were identified (25.7 ± 13.2 FPs per colonoscopy; P = .53). Among them, 22.9 ± 9.9 (89.8% in CADe A) and 22.1 ± 10.0 (86.0% in CADe B) were because of artifacts from the bowel wall. Conversely, 2.6 ± 1.9 (10.2% in CADe A) and 3.5 ± 2.1 (14% in CADe B) were caused by bowel content (P = .45). Within CADe A each false activation required .2 ± .9 seconds, with 1.6 ± 1.0 FPs (6.3%) requiring additional time for endoscopic assessment. Comparable results were reported within CADe B with .2 ± .8 seconds spent per false activation and 1.8 ± 1.2 FPs per colonoscopy requiring additional inspection. CONCLUSIONS: The use of a standardized nomenclature provided comparable results with either of the 2 recently approved CADe systems. (Clinical trial registration number: NCT04399590.).

来源:Gastrointest Endosc,查看原文。版权归原作者所有。

引用

  1. Spadaccini M, Hassan C, Alfarone L, et al. Comparing the number and relevance of false activations between 2 artificial intelligence computer-aided detection systems: the NOISE study. Gastrointest Endosc. 2022. PMID: 34995639. doi:10.1016/j.gie.2021.12.031

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。