文献速递神经重症与神经感染认知障碍与痴呆

深度学习与神经眼科专家对视盘分类的诊断性能比较

Optic Disc Classification by Deep Learning versus Expert Neuro-Ophthalmologists.
PubMed 文献 · Ann Neurol · 2020-08-07

该研究比较了人工智能深度学习系统与2名神经眼科专家在视盘外观分类上的诊断性能。系统在800张新眼底照片上的分类准确率与专家相当或更优,检测正常视盘、视乳头水肿和其他异常的AUC分别为0.97、0.96和0.89。

要点

  • 深度学习系统分类视盘的准确率与专家相当或更优。
  • 系统检测视乳头水肿的AUC达0.96,具有高判别能力。
  • 系统与专家间的一致性为中等至良好水平。

核心结论

  • 该深度学习系统在视盘异常分类上的性能至少与2名神经眼科专家相当。

研究设计与样本

  • 深度学习系统先前基于19个国际中心的14341张眼底照片训练和验证。
  • 在800张新眼底照片(400正常视盘,201视乳头水肿,199其他异常)上评估系统性能。
  • 与2名独立回顾相同随机图像且无临床信息的神经眼科专家进行比较。

主要发现

  • 系统正确分类800张中的678张(84.7%),专家1为675张(84.4%),专家2为641张(80.1%)。
  • 系统检测正常视盘、视乳头水肿和其他视盘异常的AUC分别为0.97(95%CI 0.96-0.98)、0.96(95%CI 0.94-0.97)和0.89(95%CI 0.87-0.92)。
  • 系统分类的准确率、敏感性和特异性与2名专家相似或更优。
  • 眼水平评估者间一致性:专家1与专家2为0.71(95%CI 0.67-0.76),系统与专家1为0.72(95%CI 0.68-0.76),系统与专家2为0.65(95%CI 0.61-0.70)。

临床怎么用

  • 该系统有望作为诊断辅助工具用于相关临床场景,但需前瞻性研究验证。

局限性

  • 未来需要前瞻性研究在相关临床环境中验证该系统作为诊断辅助工具的价值。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: To compare the diagnostic performance of an artificial intelligence deep learning system with that of expert neuro-ophthalmologists in classifying optic disc appearance. METHODS: The deep learning system was previously trained and validated on 14,341 ocular fundus photographs from 19 international centers. The performance of the system was evaluated on 800 new fundus photographs (400 normal optic discs, 201 papilledema [disc edema from elevated intracranial pressure], 199 other optic disc abnormalities) and compared with that of 2 expert neuro-ophthalmologists who independently reviewed the same randomly presented images without clinical information. Area under the receiver operating characteristic curve, accuracy, sensitivity, and specificity were calculated. RESULTS: The system correctly classified 678 of 800 (84.7%) photographs, compared with 675 of 800 (84.4%) for Expert 1 and 641 of 800 (80.1%) for Expert 2. The system yielded areas under the receiver operating characteristic curve of 0.97 (95% confidence interval [CI] = 0.96-0.98), 0.96 (95% CI = 0.94-0.97), and 0.89 (95% CI = 0.87-0.92) for the detection of normal discs, papilledema, and other disc abnormalities, respectively. The accuracy, sensitivity, and specificity of the system's classification of optic discs were similar to or better than the 2 experts. Intergrader agreement at the eye level was 0.71 (95% CI = 0.67-0.76) between Expert 1 and Expert 2, 0.72 (95% CI = 0.68-0.76) between the system and Expert 1, and 0.65 (95% CI = 0.61-0.70) between the system and Expert 2. INTERPRETATION: The performance of this deep learning system at classifying optic disc abnormalities was at least as good as 2 expert neuro-ophthalmologists. Future prospective studies are needed to validate this system as a diagnostic aid in relevant clinical settings. ANN NEUROL 2020;88:785-795.

来源:Ann Neurol,查看原文。版权归原作者所有。

引用

  1. Biousse V, Newman NJ, Najjar RP, et al. Optic Disc Classification by Deep Learning versus Expert Neuro-Ophthalmologists. Ann Neurol. 2020. PMID: 32621348. doi:10.1002/ana.25839

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。