基于人工智能的膀胱癌全切片图像淋巴结转移检测模型:一项回顾性、多中心、诊断性研究
该回顾性多中心诊断研究纳入998例膀胱癌患者(7991张图像)开发淋巴结转移诊断模型(LNMDM),在五个验证集中AUC为0.978至0.998。模型诊断灵敏度0.983,高于初级病理医师的0.906和高级病理医师的0.947,AI辅助使初级医师灵敏度从0.906升至0.953、高级医师从0.947升至0.986。模型在13例患者中检出病理医师漏诊的微转移。
要点
- LNMDM在五个验证集中诊断淋巴结转移的AUC为0.978至0.998。
- 模型灵敏度0.983,高于初级病理医师0.906和高级病理医师0.947。
- AI辅助使初级医师灵敏度从0.906升至0.953,高级医师从0.947升至0.986。
核心结论
- 研究开发了基于人工智能的诊断模型LNMDM,在检测淋巴结转移尤其是微转移方面表现良好,在提高病理医师工作准确性和效率方面显示出较大临床潜力。
研究设计与样本
- 回顾性、多中心、诊断性研究,纳入2013年1月1日至2021年12月31日在中国接受根治性膀胱切除术和盆腔淋巴结清扫的1012例膀胱癌患者。
- 排除14例(165张图像)合并非膀胱癌同时手术的患者及21张低质量图像后,最终纳入998例患者和7991张图像(881例[88%]男性,117例[12%]女性,中位年龄64岁[IQR 56-72],268例[27%]有淋巴结转移)开发LNMDM。
- 来自两家医院(中山大学孙逸仙纪念医院和南方医科大学珠江医院)的患者按截止日期前/后分为训练集和各自医院内部验证集,来自另外三家医院(中山大学附属第三医院、南方医科大学南方医院、南方医科大学第三附属医院)的患者作为外部验证集。
- 从五个验证集中选取困难病例组成验证子集用于比较LNMDM与病理医师性能,另收集两个数据集(来自CAMELYON16数据集的乳腺癌和中山大学孙逸仙纪念医院的 prostate cancer)用于多癌种测试。
- 主要终点为四个预设组(五个验证集、单淋巴结测试集、多癌种测试集、LNMDM与病理医师性能比较子集)的诊断灵敏度。
主要发现
- LNMDM在五个验证集中准确诊断淋巴结转移的AUC范围为0.978(95% CI 0.960-0.996)至0.998(95% CI 0.996-1.000)。
- LNMDM诊断灵敏度为0.983(95% CI 0.941-0.998),高于初级病理医师的0.906(95% CI 0.871-0.934)和高级病理医师的0.947(95% CI 0.919-0.968)。
- AI辅助使初级病理医师灵敏度从无AI的0.906升至有AI的0.953,高级病理医师从0.947升至0.986。
- 多癌种测试中,LNMDM在乳腺癌图像中AUC为0.943(95% CI 0.918-0.969),在前列腺癌图像中AUC为0.922(95% CI 0.884-0.960)。
- LNMDM在13例患者中检出病理医师此前分类为阴性而漏诊的肿瘤微转移;ROC曲线显示LNMDM可使病理医师在临床应用中排除80-92%的阴性切片同时保持100%灵敏度。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Accurate lymph node staging is important for the diagnosis and treatment of patients with bladder cancer. We aimed to develop a lymph node metastases diagnostic model (LNMDM) on whole slide images and to assess the clinical effect of an artificial intelligence-assisted (AI) workflow. METHODS: In this retrospective, multicentre, diagnostic study in China, we included consecutive patients with bladder cancer who had radical cystectomy and pelvic lymph node dissection, and from whom whole slide images of lymph node sections were available, for model development. We excluded patients with non-bladder cancer and concurrent surgery, or low-quality images. Patients from two hospitals (Sun Yat-sen Memorial Hospital of Sun Yat-sen University and Zhujiang Hospital of Southern Medical University, Guangzhou, Guangdong, China) were assigned before a cutoff date to a training set and after the date to internal validation sets for each hospital. Patients from three other hospitals (the Third Affiliated Hospital of Sun Yat-sen University, Nanfang Hospital of Southern Medical University, and the Third Affiliated Hospital of Southern Medical University, Guangzhou, Guangdong, China) were included as external validation sets. A validation subset of challenging cases from the five validation sets was used to compare performance between the LNMDM and pathologists, and two other datasets (breast cancer from the CAMELYON16 dataset and prostate cancer from the Sun Yat-sen Memorial Hospital of Sun Yat-sen University) were collected for a multi-cancer test. The primary endpoint was diagnostic sensitivity in the four prespecified groups (ie, the five validation sets, a single-lymph-node test set, the multi-cancer test set, and the subset for a performance comparison between the LNMDM and pathologists). FINDINGS: Between Jan 1, 2013 and Dec 31, 2021, 1012 patients with bladder cancer had radical cystectomy and pelvic lymph node dissection and were included (8177 images and 20 954 lymph nodes). We excluded 14 patients (165 images) with concurrent non-bladder cancer and also excluded 21 low-quality images. We included 998 patients and 7991 images (881 [88%] men; 117 [12%] women; median age 64 years [IQR 56-72]; ethnicity data not available; 268 [27%] with lymph node metastases) to develop the LNMDM. The area under the curve (AUC) for accurate diagnosis of the LNMDM ranged from 0·978 (95% CI 0·960-0·996) to 0·998 (0·996-1·000) in the five validation sets. Performance comparisons between the LNMDM and pathologists showed that the diagnostic sensitivity of the model (0·983 [95% CI 0·941-0·998]) substantially exceeded that of both junior pathologists (0·906 [0·871-0·934]) and senior pathologists (0·947 [0·919-0·968]), and that AI assistance improved sensitivity for both junior (from 0·906 without AI to 0·953 with AI) and senior (from 0·947 to 0·986) pathologists. In the multi-cancer test, the LNMDM maintained an AUC of 0·943 (95% CI 0·918-0·969) in breast cancer images and 0·922 (0·884-0·960) in prostate cancer images. In 13 patients, the LNMDM detected tumour micrometastases that had been missed by pathologists who had previously classified these patients' results as negative. Receiver operating characteristic curves showed that the LNMDM would enable pathologists to exclude 80-92% of negative slides while maintaining 100% sensitivity in clinical application. INTERPRETATION: We developed an AI-based diagnostic model that did well in detecting lymph node metastases, particularly micrometastases. The LNMDM showed substantial potential for clinical applications in improving the accuracy and efficiency of pathologists' work. FUNDING: National Natural Science Foundation of China, the Science and Technology Planning Project of Guangdong Province, the National Key Research and Development Programme of China, and the Guangdong Provincial Clinical Research Centre for Urological Diseases.
引用
- Wu S, Hong G, Xu A, et al. Artificial intelligence-based model for lymph node metastases detection on whole slide images in bladder cancer: a retrospective, multicentre, diagnostic study. Lancet Oncol. 2023. PMID: 36893772. doi:10.1016/S1470-2045(23)00061-X
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。