多模态非线性显微镜图像中的全卷积网络用于头颈癌自动检测:初步研究
本研究开发了基于全卷积神经网络(FCN)的自动图像分析算法,利用多模态非线性显微镜图像区分头颈癌与非癌上皮。共分析12例患者的114幅图像,四类(癌、正常上皮、背景、其他组织)的平均识别率为88.9%,总体识别率为86.7%,处理整张切片图像需113秒。作者认为该技术有望客观区分头颈癌与非癌上皮。
要点
- FCN算法对四类图像的平均识别率为88.9%,总体识别率为86.7%。
- 共分析12例患者的114幅图像,处理整张切片图像需113秒。
- 多模态非线性显微镜联合FCN自动分析似乎有望客观区分头颈癌与非癌上皮。
核心结论
- 多模态非线性显微镜联合FCN自动图像分析似乎有望客观区分头颈癌与非癌上皮。
研究设计与样本
- 研究为初步研究,开发基于全卷积神经网络(FCN)的自动图像分析算法。
- 头颈癌切片用于标准组织病理学,并与同一组织切片的多模态非线性显微镜图像共配准。
- 多模态图像组合了相干反斯托克斯拉曼散射、双光子激发荧光和二次谐波产生显微镜。
- 图像采用语义分割FCN分析四类:癌、正常上皮、背景和其他组织类型。
主要发现
- 共分析12例患者的114幅图像。
- 采用斑块评分聚合后,四类的平均识别率为88.9%,总体识别率为86.7%。
- 数据集中处理整张切片图像需113秒。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: A fully convolutional neural networks (FCN)-based automated image analysis algorithm to discriminate between head and neck cancer and noncancerous epithelium based on nonlinear microscopic images was developed. METHODS: Head and neck cancer sections were used for standard histopathology and co-registered with multimodal images from the same sections using the combination of coherent anti-Stokes Raman scattering, two-photon excited fluorescence, and second harmonic generation microscopy. The images analyzed with semantic segmentation using a FCN for four classes: cancer, normal epithelium, background, and other tissue types. RESULTS: A total of 114 images of 12 patients were analyzed. Using a patch score aggregation, the average recognition rate and an overall recognition rate or the four classes were 88.9% and 86.7%, respectively. A total of 113 seconds were needed to process a whole-slice image in the dataset. CONCLUSION: Multimodal nonlinear microscopy in combination with automated image analysis using FCN seems to be a promising technique for objective differentiation between head and neck cancer and noncancerous epithelium.
引用
- Rodner E, Bocklitz T, von Eggeling F, et al. Fully convolutional networks in multimodal nonlinear microscopy images for automated detection of head and neck carcinoma: Pilot study. Head Neck. 2018. PMID: 30548511. doi:10.1002/hed.25489
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。