文献速递皮肤肿瘤

2016年国际皮肤影像协作组织生物医学成像挑战赛结果:计算机算法与皮肤科医生对皮肤镜图像诊断黑色素瘤准确性的比较

Results of the 2016 International Skin Imaging Collaboration International Symposium on Biomedical Imaging challenge: Comparison of the accuracy of computer algorithms to dermatologists for the diagnosis of melanoma from dermoscopic images.
PubMed 文献 · J Am Acad Dermatol · 2017-09-29

该横断面研究使用100张随机选取的皮肤镜图像(50例黑色素瘤、44例痣、6例雀斑样痣),比较25支团队的算法与8名皮肤科医生的诊断准确性。皮肤科医生平均敏感性和特异性分别为82%和59%。

要点

  • 深度学习算法在皮肤镜黑色素瘤诊断中准确性超过部分但非全部皮肤科医生
  • 研究设计限制结果不能外推至临床实践

核心结论

  • 深度学习计算机视觉系统对皮肤镜黑色素瘤图像的分类准确性超过部分但非全部皮肤科医生。

研究设计与样本

  • 横断面研究使用来自国际计算机视觉黑色素瘤挑战数据集(n=379)的100张随机选取皮肤镜图像(50例黑色素瘤、44例痣、6例雀斑样痣),以及25支团队的个体算法结果。
  • 采用5种方法(非学习和机器学习)将个体自动化预测组合成「融合」算法;在 companion 研究中,8名皮肤科医生将100张图像中的病变分类为良性或恶性。

主要发现

  • 皮肤科医生分类的平均敏感性和特异性分别为82%和59%。

临床怎么用

  • 计算机视觉算法可能辅助黑色素瘤检测,但准确性并非全面优于皮肤科医生。
  • 研究结果基于特定数据集和缺乏临床数据的设计,不能直接 extrapolate 到临床实践。

局限性

  • 数据集缺乏临床实践中遇到的完整皮肤病变谱,特别是普通良性病变。
  • 读者和算法未提供临床数据(如年龄或病变历史/症状)。
  • 使用本研究设计获得的结果不能外推至临床实践。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Computer vision may aid in melanoma detection. OBJECTIVE: We sought to compare melanoma diagnostic accuracy of computer algorithms to dermatologists using dermoscopic images. METHODS: We conducted a cross-sectional study using 100 randomly selected dermoscopic images (50 melanomas, 44 nevi, and 6 lentigines) from an international computer vision melanoma challenge dataset (n = 379), along with individual algorithm results from 25 teams. We used 5 methods (nonlearned and machine learning) to combine individual automated predictions into "fusion" algorithms. In a companion study, 8 dermatologists classified the lesions in the 100 images as either benign or malignant. RESULTS: The average sensitivity and specificity of dermatologists in classification was 82% and 59%. At 82% sensitivity, dermatologist specificity was similar to the top challenge algorithm (59% vs. 62%, P = .68) but lower than the best-performing fusion algorithm (59% vs. 76%, P = .02). Receiver operating characteristic area of the top fusion algorithm was greater than the mean receiver operating characteristic area of dermatologists (0.86 vs. 0.71, P = .001). LIMITATIONS: The dataset lacked the full spectrum of skin lesions encountered in clinical practice, particularly banal lesions. Readers and algorithms were not provided clinical data (eg, age or lesion history/symptoms). Results obtained using our study design cannot be extrapolated to clinical practice. CONCLUSION: Deep learning computer vision systems classified melanoma dermoscopy images with accuracy that exceeded some but not all dermatologists.

来源:J Am Acad Dermatol,查看原文。版权归原作者所有。

引用

  1. Marchetti MA, Codella NCF, Dusza SW, et al. Results of the 2016 International Skin Imaging Collaboration International Symposium on Biomedical Imaging challenge: Comparison of the accuracy of computer algorithms to dermatologists for the diagnosis of melanoma from dermoscopic images. J Am Acad Dermatol. 2017. PMID: 28969863. doi:10.1016/j.jaad.2017.08.016

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。