人机结合提升皮肤癌分类准确率
本研究使用11,444张皮肤镜图像训练单一卷积神经网络(CNN),并由13家德国大学医院的112名皮肤科医生与CNN各自独立对300例活检证实的皮肤病变进行五分类。将两者诊断按决策确定性经梯度提升法融合后,多分类准确率达82.95%,优于任一单独分类器。
要点
- 人机融合多分类准确率82.95%,高于CNN单独的81.59%。
- 二分类任务中融合分类器敏感度89%,优于CNN的86.1%。
- 融合分类器特异度由89.2%降至84%,同等敏感度下CNN仅81.5%。
核心结论
- 人机结合的分类结果优于人与人工智能各自独立的结果。
研究设计与样本
- 用11,444张皮肤镜图像分五类诊断训练单一CNN;112名来自13家德国大学医院的皮肤科医生与CNN独立分类300例活检证实的皮肤病变;经梯度提升法结合两者诊断。
主要发现
- 多分类任务中人机结合准确率为82.95%,比最佳单独分类器(CNN的81.59%)高1.36%。
- 二分类任务因类别不平衡仅考察敏感度,融合分类器为89%,优于最佳单独分类器(CNN的86.1%)。
- 融合分类器特异度从89.2%降至84%,而在相同敏感度89%下CNN特异度仅为81.5%。
临床怎么用
- 提示皮肤癌分类可将人工智能输出与医生判断按决策确定性融合,以提升分类表现。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: In recent studies, convolutional neural networks (CNNs) outperformed dermatologists in distinguishing dermoscopic images of melanoma and nevi. In these studies, dermatologists and artificial intelligence were considered as opponents. However, the combination of classifiers frequently yields superior results, both in machine learning and among humans. In this study, we investigated the potential benefit of combining human and artificial intelligence for skin cancer classification. METHODS: Using 11,444 dermoscopic images, which were divided into five diagnostic categories, novel deep learning techniques were used to train a single CNN. Then, both 112 dermatologists of 13 German university hospitals and the trained CNN independently classified a set of 300 biopsy-verified skin lesions into those five classes. Taking into account the certainty of the decisions, the two independently determined diagnoses were combined to a new classifier with the help of a gradient boosting method. The primary end-point of the study was the correct classification of the images into five designated categories, whereas the secondary end-point was the correct classification of lesions as either benign or malignant (binary classification). FINDINGS: Regarding the multiclass task, the combination of man and machine achieved an accuracy of 82.95%. This was 1.36% higher than the best of the two individual classifiers (81.59% achieved by the CNN). Owing to the class imbalance in the binary problem, sensitivity, but not accuracy, was examined and demonstrated to be superior (89%) to the best individual classifier (CNN with 86.1%). The specificity in the combined classifier decreased from 89.2% to 84%. However, at an equal sensitivity of 89%, the CNN achieved a specificity of only 81.5% INTERPRETATION: Our findings indicate that the combination of human and artificial intelligence achieves superior results over the independent results of both of these systems.
引用
- Hekler A, Utikal JS, Enk AH, et al. Superior skin cancer classification by the combination of human and artificial intelligence. Eur J Cancer. 2019. PMID: 31518967. doi:10.1016/j.ejca.2019.07.019
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。