文献速递骨软组织肉瘤与黑色素瘤

基于皮肤镜图像训练的卷积神经网络在临床黑色素瘤图像分类任务中与145名皮肤科医生表现相当

A convolutional neural network trained with dermoscopic images performed on par with 145 dermatologists in a clinical melanoma image classification task.
PubMed 文献 · Eur J Cancer · 2019-03-08

本研究比较了仅用皮肤镜图像训练的卷积神经网络(CNN)与145名德国大学医院皮肤科医生对100张临床图像进行黑色素瘤分类的表现。皮肤科医生的平均敏感性和特异性分别为89.4%和64.4%,而CNN在相同敏感性下平均特异性为68.2%。CNN结果方差更小,提示计算机视觉在皮肤科图像分类任务中稳健性更高。

要点

  • 皮肤科医生对临床图像的平均敏感性为89.4%(范围55.0%-100%),平均特异性为64.4%(范围22.5%-92.5%)。
  • 在相同敏感性下,CNN的平均特异性为68.2%(范围47.5%-86.25%)。
  • 主治医师平均敏感性最高达92.8%,此时平均特异性为57.7%;相同敏感性下CNN平均特异性为61.1%。

核心结论

  • 首次在未用临床图像训练的情况下,在临床图像分类任务中达到了皮肤科医生级别的分类水平。
  • CNN结果方差更小,提示计算机视觉在皮肤科图像分类任务中比人类评估稳健性更高。

研究设计与样本

  • 比较研究:将仅用12,378张开源皮肤镜图像训练的CNN与145名来自12家德国大学医院的皮肤科医生进行比较。
  • 使用100张临床图像比较CNN与皮肤科医生的表现,评价指标包括敏感性、特异性和受试者工作特征。

主要发现

  • 皮肤科医生对临床图像的平均敏感性为89.4%(范围55.0%-100%),平均特异性为64.4%(范围22.5%-92.5%)。
  • 在相同敏感性下,CNN的平均特异性为68.2%(范围47.5%-86.25%)。
  • 主治医师平均敏感性最高为92.8%,此时平均特异性为57.7%;相同敏感性下CNN平均特异性为61.1%。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Recent studies have demonstrated the use of convolutional neural networks (CNNs) to classify images of melanoma with accuracies comparable to those achieved by board-certified dermatologists. However, the performance of a CNN exclusively trained with dermoscopic images in a clinical image classification task in direct competition with a large number of dermatologists has not been measured to date. This study compares the performance of a convolutional neuronal network trained with dermoscopic images exclusively for identifying melanoma in clinical photographs with the manual grading of the same images by dermatologists. METHODS: We compared automatic digital melanoma classification with the performance of 145 dermatologists of 12 German university hospitals. We used methods from enhanced deep learning to train a CNN with 12,378 open-source dermoscopic images. We used 100 clinical images to compare the performance of the CNN to that of the dermatologists. Dermatologists were compared with the deep neural network in terms of sensitivity, specificity and receiver operating characteristics. FINDINGS: The mean sensitivity and specificity achieved by the dermatologists with clinical images was 89.4% (range: 55.0%-100%) and 64.4% (range: 22.5%-92.5%). At the same sensitivity, the CNN exhibited a mean specificity of 68.2% (range 47.5%-86.25%). Among the dermatologists, the attendings showed the highest mean sensitivity of 92.8% at a mean specificity of 57.7%. With the same high sensitivity of 92.8%, the CNN had a mean specificity of 61.1%. INTERPRETATION: For the first time, dermatologist-level image classification was achieved on a clinical image classification task without training on clinical images. The CNN had a smaller variance of results indicating a higher robustness of computer vision compared with human assessment for dermatologic image classification tasks.

来源:Eur J Cancer,查看原文。版权归原作者所有。

引用

  1. Brinker TJ, Hekler A, Enk AH, et al. A convolutional neural network trained with dermoscopic images performed on par with 145 dermatologists in a clinical melanoma image classification task. Eur J Cancer. 2019. PMID: 30852421. doi:10.1016/j.ejca.2019.02.005

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。