文献速递皮肤肿瘤

联邦学习用于黑色素瘤诊断的去中心化人工智能

Federated Learning for Decentralized Artificial Intelligence in Melanoma Diagnostics.
PubMed 文献 · JAMA Dermatol · 2024-01-01

该多中心单臂诊断研究基于6家德国大学医院2021年4月至2023年2月前瞻性获取的组织病理全切片图像,开发联邦学习模型进行黑色素瘤与痣的分类,并与集中式和集成学习方法比较。联邦方法在保留测试集上AUROC显著低于集中式方法,但在外部测试集上显著优于集中式方法,且均显著低于集成方法。结论提示联邦学习是可行方案,可提升隐私保护并促进跨机构合作。

要点

  • 联邦学习在外部测试集AUROC优于集中式,但保留测试集表现较差。
  • 联邦学习在保留和外部测试集上均显著劣于集成学习方法。
  • 联邦学习可用于黑色素瘤与痣的二分类,兼顾隐私与协作。

核心结论

  • 联邦学习是用于浸润性黑色素瘤与痣二分类的可行方法,可改善隐私保护并促进跨机构合作。

研究设计与样本

  • 多中心单臂诊断研究,使用6家德国大学医院2021年4月至2023年2月前瞻性获取的组织病理全切片图像。
  • 纳入1025张临床疑似黑色素瘤皮损的全切片图像,来自923例患者,包括388例组织病理确诊的浸润性黑色素瘤和637例痣。

主要发现

  • 联邦方法在保留测试集AUROC为0.8579(95%CI 0.7693-0.9299),显著低于集中式方法的0.9024(95%CI 0.8379-0.9565)(P < .001)。
  • 联邦方法在外部测试集AUROC为0.9126(95%CI 0.8810-0.9412),显著高于集中式方法的0.9045(95%CI 0.8701-0.9331)(P < .001)。
  • 联邦方法在保留测试集AUROC显著低于集成方法的0.8867(95%CI 0.8103-0.9481)。
  • 联邦方法在外部测试集AUROC显著低于集成方法的0.9227(95%CI 0.8941-0.9479)。

临床怎么用

  • 联邦学习可作为黑色素瘤AI诊断中保护隐私的分布式协作方案。
  • 在临床部署前需评估联邦模型在不同数据集上的性能差异,尤其与集成方法的差距。

局限性

  • 研究为单臂诊断研究,未报告样本量计算或外部验证的广泛代表性。
  • 联邦方法在保留测试集上表现低于集中式,且在两个测试集上均低于集成方法。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

IMPORTANCE: The development of artificial intelligence (AI)-based melanoma classifiers typically calls for large, centralized datasets, requiring hospitals to give away their patient data, which raises serious privacy concerns. To address this concern, decentralized federated learning has been proposed, where classifier development is distributed across hospitals. OBJECTIVE: To investigate whether a more privacy-preserving federated learning approach can achieve comparable diagnostic performance to a classical centralized (ie, single-model) and ensemble learning approach for AI-based melanoma diagnostics. DESIGN, SETTING, AND PARTICIPANTS: This multicentric, single-arm diagnostic study developed a federated model for melanoma-nevus classification using histopathological whole-slide images prospectively acquired at 6 German university hospitals between April 2021 and February 2023 and benchmarked it using both a holdout and an external test dataset. Data analysis was performed from February to April 2023. EXPOSURES: All whole-slide images were retrospectively analyzed by an AI-based classifier without influencing routine clinical care. MAIN OUTCOMES AND MEASURES: The area under the receiver operating characteristic curve (AUROC) served as the primary end point for evaluating the diagnostic performance. Secondary end points included balanced accuracy, sensitivity, and specificity. RESULTS: The study included 1025 whole-slide images of clinically melanoma-suspicious skin lesions from 923 patients, consisting of 388 histopathologically confirmed invasive melanomas and 637 nevi. The median (range) age at diagnosis was 58 (18-95) years for the training set, 57 (18-93) years for the holdout test dataset, and 61 (18-95) years for the external test dataset; the median (range) Breslow thickness was 0.70 (0.10-34.00) mm, 0.70 (0.20-14.40) mm, and 0.80 (0.30-20.00) mm, respectively. The federated approach (0.8579; 95% CI, 0.7693-0.9299) performed significantly worse than the classical centralized approach (0.9024; 95% CI, 0.8379-0.9565) in terms of AUROC on a holdout test dataset (pairwise Wilcoxon signed-rank, P < .001) but performed significantly better (0.9126; 95% CI, 0.8810-0.9412) than the classical centralized approach (0.9045; 95% CI, 0.8701-0.9331) on an external test dataset (pairwise Wilcoxon signed-rank, P < .001). Notably, the federated approach performed significantly worse than the ensemble approach on both the holdout (0.8867; 95% CI, 0.8103-0.9481) and external test dataset (0.9227; 95% CI, 0.8941-0.9479). CONCLUSIONS AND RELEVANCE: The findings of this diagnostic study suggest that federated learning is a viable approach for the binary classification of invasive melanomas and nevi on a clinically representative distributed dataset. Federated learning can improve privacy protection in AI-based melanoma diagnostics while simultaneously promoting collaboration across institutions and countries. Moreover, it may have the potential to be extended to other image classification tasks in digital cancer histopathology and beyond.

来源:JAMA Dermatol,查看原文。版权归原作者所有。

引用

  1. Haggenmüller S, Schmitt M, Krieghoff-Henning E, et al. Federated Learning for Decentralized Artificial Intelligence in Melanoma Diagnostics. JAMA Dermatol. 2024. PMID: 38324293. doi:10.1001/jamadermatol.2023.5550

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。