皮肤科医生与卷积神经网络合作诊断的前瞻性临床研究
这项前瞻性双中心研究评估皮肤科医生与市场批准的CNN合作分类黑素细胞病变的诊断性能。22名皮肤科医生检测228个可疑病变,整合CNN结果后,平均敏感性从84.2%升至100.0%,特异性从72.1%升至83.7%,准确性从74.1%升至86.4%。与CNN合作还使良性痣的不必要切除从54.7%降至19.2%。
要点
- 皮肤科医生与CNN合作后诊断敏感性、特异性、准确性均显著提高。
- 合作使良性痣的不必要切除减少19.2%。
- 皮肤镜经验较少的医生与CNN合作诊断改善最明显。
核心结论
- 在这项前瞻性诊断研究中,皮肤科医生与市场批准的CNN合作可能提高其诊断性能,这种人机合作方式的更广泛应用可能对医生和患者有益。
研究设计与样本
- 前瞻性诊断性双中心研究,22名皮肤科医生在188例患者中检测228个可疑黑素细胞病变(190个痣,38个黑素瘤)。
- 参考诊断基于125个(54.8%)病变的组织病理学检查,未切除病变基于临床随访数据和专家共识。
- 数据收集时间为2020年10月至2021年10月。
关键数值与推荐
- 皮肤科医生对可疑黑素细胞病变的恶性概率评分范围0-1,恶性阈值≥0.5。
- CNN(Moleanalyzer Pro)恶性评分范围0-1,恶性阈值≥0.5。
- 主要结局指标为皮肤科医生单独与皮肤科医生合作CNN的诊断敏感性和特异性。
临床怎么用
- 皮肤科医生在分类黑素细胞病变时,可考虑与市场批准的CNN合作以改善诊断性能。
- 皮肤镜经验较少的医生与CNN合作可能获得更明显的诊断改善。
局限性
- 原文未述局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
IMPORTANCE: Studies suggest that convolutional neural networks (CNNs) perform equally to trained dermatologists in skin lesion classification tasks. Despite the approval of the first neural networks for clinical use, prospective studies demonstrating benefits of human with machine cooperation are lacking. OBJECTIVE: To assess whether dermatologists benefit from cooperation with a market-approved CNN in classifying melanocytic lesions. DESIGN, SETTING, AND PARTICIPANTS: In this prospective diagnostic 2-center study, dermatologists performed skin cancer screenings using naked-eye examination and dermoscopy. Dermatologists graded suspect melanocytic lesions by the probability of malignancy (range 0-1, threshold for malignancy ≥0.5) and indicated management decisions (no action, follow-up, excision). Next, dermoscopic images of suspect lesions were assessed by a market-approved CNN, Moleanalyzer Pro (FotoFinder Systems). The CNN malignancy scores (range 0-1, threshold for malignancy ≥0.5) were transferred to dermatologists with the request to re-evaluate lesions and revise initial decisions in consideration of CNN results. Reference diagnoses were based on histopathologic examination in 125 (54.8%) lesions or, in the case of nonexcised lesions, on clinical follow-up data and expert consensus. Data were collected from October 2020 to October 2021. MAIN OUTCOMES AND MEASURES: Primary outcome measures were diagnostic sensitivity and specificity of dermatologists alone and dermatologists cooperating with the CNN. Accuracy and receiver operator characteristic area under the curve (ROC AUC) were considered as additional measures. RESULTS: A total of 22 dermatologists detected 228 suspect melanocytic lesions (190 nevi, 38 melanomas) in 188 patients (mean [range] age, 53.4 [19-91] years; 97 [51.6%] male patients). Diagnostic sensitivity and specificity significantly improved when dermatologists additionally integrated CNN results into decision-making (mean sensitivity from 84.2% [95% CI, 69.6%-92.6%] to 100.0% [95% CI, 90.8%-100.0%]; P = .03; mean specificity from 72.1% [95% CI, 65.3%-78.0%] to 83.7% [95% CI, 77.8%-88.3%]; P < .001; mean accuracy from 74.1% [95% CI, 68.1%-79.4%] to 86.4% [95% CI, 81.3%-90.3%]; P < .001; and mean ROC AUC from 0.895 [95% CI, 0.836-0.954] to 0.968 [95% CI, 0.948-0.988]; P = .005). In addition, the CNN alone achieved a comparable sensitivity, higher specificity, and higher diagnostic accuracy compared with dermatologists alone in classifying melanocytic lesions. Moreover, unnecessary excisions of benign nevi were reduced by 19.2%, from 104 (54.7%) of 190 benign nevi to 84 nevi when dermatologists cooperated with the CNN (P < .001). Most lesions were examined by dermatologists with 2 to 5 years (96, 42.1%) or less than 2 years of experience (78, 34.2%); others (54, 23.7%) were evaluated by dermatologists with more than 5 years of experience. Dermatologists with less dermoscopy experience cooperating with the CNN had the most diagnostic improvement compared with more experienced dermatologists. CONCLUSIONS AND RELEVANCE: In this prospective diagnostic study, these findings suggest that dermatologists may improve their performance when they cooperate with the market-approved CNN and that a broader application of this human with machine approach could be beneficial for dermatologists and patients.
引用
- Winkler JK, Blum A, Kommoss K, et al. Assessment of Diagnostic Performance of Dermatologists Cooperating With a Convolutional Neural Network in a Prospective Clinical Study: Human With Machine. JAMA Dermatol. 2023. PMID: 37133847. doi:10.1001/jamadermatol.2023.0905
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。