智能手机拍摄显微目镜图像结合深度神经网络识别基底细胞癌
本研究基于8046张智能手机拍摄的显微目镜图像(MOI)和128张全切片图像(WSI),开发了两种深度学习框架用于基底细胞癌(BCC)的识别与分割。
核心结论
- 基于智能手机拍摄的MOI可开发高灵敏度与特异度的深度学习框架识别BCC病理。
研究设计与样本
- 收集8046张MOI(6610张有二分类标签,1436张有像素级标注)和128张WSI用于比较。
- 创建两种深度学习框架:级联框架(分类模型识别困难病例,分割模型深入分析)和分割框架(直接分割并分类所有图像)。
临床怎么用
- 智能手机拍摄显微目镜图像可作为BCC自动诊断的未来临床选择。
- 分割框架适合对准确度要求高的场景,级联框架适合需快速处理的场景。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Pioneering effort has been made to facilitate the recognition of pathology in malignancies based on whole-slide images (WSIs) through deep learning approaches. It remains unclear whether we can accurately detect and locate basal cell carcinoma (BCC) using smartphone-captured images. OBJECTIVES: To develop deep neural network frameworks for accurate BCC recognition and segmentation based on smartphone-captured microscopic ocular images (MOIs). METHODS: We collected a total of 8046 MOIs, 6610 of which had binary classification labels and the other 1436 had pixelwise annotations. Meanwhile, 128 WSIs were collected for comparison. Two deep learning frameworks were created. The 'cascade' framework had a classification model for identifying hard cases (images with low prediction confidence) and a segmentation model for further in-depth analysis of the hard cases. The 'segmentation' framework directly segmented and classified all images. Sensitivity, specificity and area under the curve (AUC) were used to evaluate the overall performance of BCC recognition. RESULTS: The MOI- and WSI-based models achieved comparable AUCs around 0·95. The 'cascade' framework achieved 0·93 sensitivity and 0·91 specificity. The 'segmentation' framework was more accurate but required more computational resources, achieving 0·97 sensitivity, 0·94 specificity and 0·987 AUC. The runtime of the 'segmentation' framework was 15·3 ± 3·9 s per image, whereas the 'cascade' framework took 4·1 ± 1·4 s. Additionally, the 'segmentation' framework achieved 0·863 mean intersection over union. CONCLUSIONS: Based on the accessible MOIs via smartphone photography, we developed two deep learning frameworks for recognizing BCC pathology with high sensitivity and specificity. This work opens a new avenue for automatic BCC diagnosis in different clinical scenarios. What's already known about this topic? The diagnosis of basal cell carcinoma (BCC) is labour intensive due to the large number of images to be examined, especially when consecutive slide reading is needed in Mohs surgery. Deep learning approaches have demonstrated promising results on pathological image-related diagnostic tasks. Previous studies have focused on whole-slide images (WSIs) and leveraged classification on image patches for detecting and localizing breast cancer metastases. What does this study add? Instead of WSIs, microscopic ocular images (MOIs) photographed from microscope eyepieces using smartphone cameras were used to develop neural network models for recognizing BCC automatically. The MOI- and WSI-based models achieved comparable areas under the curve around 0·95. Two deep learning frameworks for recognizing BCC pathology were developed with high sensitivity and specificity. Recognizing BCC through a smartphone could be considered a future clinical choice.
引用
- Jiang YQ, Xiong JH, Li HY, et al. Recognizing basal cell carcinoma on smartphone-captured digital histopathology images with a deep neural network. Br J Dermatol. 2019. PMID: 31017653. doi:10.1111/bjd.18026
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。