卷积神经网络识别色素性皮肤病变的稳健性
该研究训练三种常用CNN架构区分皮肤镜下的黑色素瘤与痣,并在人工生成和自然获取的扰动图像集上测试其脆性。所有架构均表现出脆性,附加数据增强、测试时增强和抗锯齿可不同程度降低脆性但无法完全消除。
要点
- CNN区分黑色素瘤与痣时对微小图像变化存在脆性。
- 附加数据增强、测试时增强和抗锯齿可降低脆性但无法完全消除。
- 人工扰动集的改善大于自然扰动集,后者提升有限。
核心结论
- 微小图像变化可影响CNN区分皮肤病变的稳健性,所测试方法可减少但无法完全消除该效应。
研究设计与样本
- 训练三种常用CNN架构区分皮肤镜下的黑色素瘤与痣图像,并在两个测试集上评估性能与脆性。
主要发现
- 所有架构在人工和自然测试集上均表现出脆性。
- 三种方法可不同程度降低脆性并维持性能。
- 人工测试集的改善大于自然测试集,自然集提升有限。
临床怎么用
- 将AI图像分析系统整合至临床前需关注其对图像采集微小变化的稳健性。
局限性
- 所测试方法可降低但无法完全消除脆性,需进一步研究以维持AI分类器性能。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: A basic requirement for artificial intelligence (AI)-based image analysis systems, which are to be integrated into clinical practice, is a high robustness. Minor changes in how those images are acquired, for example, during routine skin cancer screening, should not change the diagnosis of such assistance systems. OBJECTIVE: To quantify to what extent minor image perturbations affect the convolutional neural network (CNN)-mediated skin lesion classification and to evaluate three possible solutions for this problem (additional data augmentation, test-time augmentation, anti-aliasing). METHODS: We trained three commonly used CNN architectures to differentiate between dermoscopic melanoma and nevus images. Subsequently, their performance and susceptibility to minor changes ('brittleness') was tested on two distinct test sets with multiple images per lesion. For the first set, image changes, such as rotations or zooms, were generated artificially. The second set contained natural changes that stemmed from multiple photographs taken of the same lesions. RESULTS: All architectures exhibited brittleness on the artificial and natural test set. The three reviewed methods were able to decrease brittleness to varying degrees while still maintaining performance. The observed improvement was greater for the artificial than for the natural test set, where enhancements were minor. CONCLUSIONS: Minor image changes, relatively inconspicuous for humans, can have an effect on the robustness of CNNs differentiating skin lesions. By the methods tested here, this effect can be reduced, but not fully eliminated. Thus, further research to sustain the performance of AI classifiers is needed to facilitate the translation of such systems into the clinic.
引用
- Maron RC, Haggenmüller S, von Kalle C, et al. Robustness of convolutional neural networks in recognition of pigmented skin lesions. Eur J Cancer. 2021. PMID: 33423009. doi:10.1016/j.ejca.2020.11.020
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。