基于机器学习算法的智能手机应用对皮肤病变分诊的准确性
在285例组织病理学验证的皮肤癌病例中,检测(前)恶性病变的敏感性为95.1%(95%CI 91.9-97.3%),特异性为78.3%(95%CI 77.2-79.3%)。结论认为该应用对皮肤癌检测具有高敏感性,但特异性仍有改进空间。
要点
- 该应用检测(前)恶性病变敏感性达95.1%,恶性黑色素瘤为93%。
- 角质形成细胞癌及前驱病变敏感性为97%,特异性为78.3%。
- 特异性仍有改进空间,需进一步评估对健康系统的影响。
核心结论
- 该智能手机应用对皮肤癌检测具有高敏感性,但特异性仍有改进空间。
研究设计与样本
- 敏感性评估使用285例组织病理学验证的皮肤癌病例(含138例恶性黑色素瘤),来自两项已发表临床研究(195例)和SA用户数据库(90例)。
- 特异性在SA用户数据库另一组6000例临床验证良性病例中计算。
主要发现
- 检测(前)恶性病变的敏感性为95.1%(95%CI 91.9-97.3%)。
- 恶性黑色素瘤敏感性为93%,角质形成细胞癌及前驱病变敏感性为97%。
- 特异性为78.3%(95%CI 77.2-79.3%)。
临床怎么用
- 该应用可用于皮肤病变风险分诊,高敏感性有助于减少漏诊。
- 特异性有限,阳性结果需结合临床进一步确认。
局限性
- 特异性仍有改进空间。
- 需未来研究评估该应用对健康系统及用户的影响。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Machine learning algorithms achieve expert-level accuracy in skin lesion classification based on clinical images. However, it is not yet shown whether these algorithms could have high accuracy when embedded in a smartphone app, where image quality is lower and there is high variability in image taking scenarios by users. In the past, these applications were criticized due to lack of accuracy. OBJECTIVE: In this study, we evaluate the accuracy of the newest version of a smartphone application (SA) for risk assessment of skin lesions. METHODS: This SA uses a machine learning algorithm to compute a risk rating. The algorithm is trained on 131 873 images taken by 31 449 users in multiple countries between January 2016 and August 2018 and rated for risk by dermatologists. To evaluate the sensitivity of the algorithm, we use 285 histopathologically validated skin cancer cases (including 138 malignant melanomas), from two previously published clinical studies (195 cases) and from the SA user database (90 cases). We calculate the specificity on a separate set from the SA user database containing 6000 clinically validated benign cases. RESULTS: The algorithm scored a 95.1% (95% CI, 91.9-97.3%) sensitivity in detecting (pre)malignant conditions (93% for malignant melanoma and 97% for keratinocyte carcinomas and precursors). This level of sensitivity was achieved with a 78.3% (95% CI, 77.2-79.3%) specificity. CONCLUSIONS: This SA provides a high sensitivity to detect skin cancer; however, there is still room for improvement in terms of specificity. Future studies are needed to assess the impact of this SA on the health systems and its users.
引用
- Udrea A, Mitra GD, Costea D, et al. Accuracy of a smartphone application for triage of skin lesions based on machine learning algorithms. J Eur Acad Dermatol Venereol. 2019. PMID: 31494983. doi:10.1111/jdv.15935
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。