基于CT与内镜图像的人工智能多模态模型用于胃癌病理分期的开发与验证
回顾性纳入2017年3月至2024年3月治疗的691例胃癌患者,收集增强静脉期CT、内镜图像及术后病理结果,构建DeepCT、HandcraftedCT和DeepEndo三种建模途径,并以堆叠集成法将各途径表现最优的两个模型整合为综合多模态模型。该模型在测试集上ROC-AUC为0.933(95%CI 0.887-0.979),敏感度0.869、特异度0.840,优于各单一模型。
要点
- 综合多模态模型测试集ROC-AUC 0.933(95%CI 0.887-0.979),敏感度0.869、特异度0.840。
- 模型整合CT影像组学与深度学习特征及内镜深度学习特征,假阳性率与假阴性率降低。
- 建模基于增强静脉期CT与内镜图像,用于胃癌术前病理分期。
核心结论
- 综合多模态模型有效整合CT与内镜图像的影像组学及深度学习特征,在胃癌术前病理分期中表现出更优性能。
- 该多模态方法提高预测准确性,为临床医生制定个体化治疗方案提供可靠工具,从而改善患者结局。
研究设计与样本
- 回顾性研究,纳入2017年3月至2024年3月治疗的691例胃癌患者。
- 采集增强静脉期CT图像、内镜图像及术后病理结果。
- 构建三种建模途径:9种深度学习模型应用于CT图像(DeepCT);11种机器学习算法使用CT图像手工影像组学特征(HandcraftedCT);ResNet-50提取内镜图像深度特征后结合11种机器学习算法(DeepEndo)。
- 各途径表现最优的两个模型通过堆叠集成法整合为综合多模态模型。
- 以ROC-AUC、敏感度和特异度评估性能。
诊断标准与关键数值
- 综合多模态模型在测试集上ROC-AUC为0.933(95%CI 0.887-0.979)。
- 综合多模态模型敏感度为0.869,特异度为0.840。
- 综合多模态模型在测试集上优于各单一模型。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
RATIONALE AND OBJECTIVES: Accurate preoperative pathological staging of gastric cancer is crucial for optimal treatment selection and improved patient outcomes. Traditional imaging methods such as CT and endoscopy have limitations in staging accuracy.
METHODS: This retrospective study included 691 gastric cancer patients treated from March 2017 to March 2024. Enhanced venous-phase CT and endoscopic images, along with postoperative pathological results, were collected. We developed three modeling approaches: (1) nine deep learning models applied to CT images (DeepCT), (2) 11 machine learning algorithms using handcrafted radiomic features from CT images (HandcraftedCT), and (3) ResNet-50-extracted deep features from endoscopic images followed by 11 machine learning algorithms (DeepEndo). The two top-performing models from each approach were combined into the Integrated Multi-Modal Model using a stacking ensemble method. Performance was assessed using ROC-AUC, sensitivity, and specificity.
RESULTS: The Integrated Multi-Modal Model achieved an ROC-AUC of 0.933 (95% CI, 0.887-0.979) on the test set, outperforming individual models. Sensitivity and specificity were 0.869 and 0.840, respectively. Various evaluation metrics demonstrated that the final fusion model effectively integrated the strengths of each sub-model, resulting in a balanced and robust performance with reduced false-positive and false-negative rates.
CONCLUSION: The Integrated Multi-Modal Model effectively integrates radiomic and deep learning features from CT and endoscopic images, demonstrating superior performance in preoperative pathological staging of gastric cancer. This multimodal approach enhances predictive accuracy and provides a reliable tool for clinicians to develop individualized treatment plans, thereby improving patient outcomes.
DATA AVAILABILITY: The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical reasons. All code used in this study is based on third-party libraries and all custom code developed for this study is available upon reasonable request from the corresponding author.
引用
- Zhang C, Li S, Huang D, et al. Development and Validation of an AI-Based Multimodal Model for Pathological Staging of Gastric Cancer Using CT and Endoscopic Images. Acad Radiol. 2025. PMID: 39753481. doi:10.1016/j.acra.2024.12.029
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。