MuTriM:整合纵向影像组学与病理组学特征的多尺度深度学习模型预测乳腺癌复发及辅助放疗获益
MuTriM是一种整合DCE-MRI影像组学与全切片病理组学特征的多模态深度学习模型,采用基于注意力的跨模态跨时间融合框架。模型在FUSCC队列(N=335)训练、TCGA队列(N=126)外部测试,可预测无复发生存并在不同亚型中展现预后价值,高评分与辅助放疗获益相关。
要点
- MuTriM在亚型无关 setting 中预测RFS的HR=5.26,C-index=0.75,优于单模态模型。
- 高MuTriM评分者RFS改善(HR=0.15),低评分者无显著获益(交互P=0.04)。
- 高风险肿瘤转录组显示细胞毒性T细胞活性受抑及免疫逃逸相关通路富集。
核心结论
- MuTriM整合影像、病理与转录组学,为乳腺癌预后和治疗指导提供可解释的多模态框架。
研究设计与样本
- 多模态深度学习模型研究,训练集为FUSCC队列(N=335),外部测试集为TCGA队列(N=126),均使用匹配的DCE-MRI与WSI。
主要发现
- MuTriM在亚型无关 setting 中预测RFS的HR=5.26(95%CI 1.69-16.4,p=0.004),C-index=0.75,优于DCE-MRI单模态(C-index=0.65)和WSI单模态(C-index=0.70)。
- MuTriM在HER2+人群(HR=6.82,95%CI 1.08-43.2,p=0.04)和ER+人群(HR=4.61,95%CI 1.25-17.1,p=0.02)中具有预后价值。
- 高MuTriM评分与RFS改善相关(HR=0.15,95%CI 0.03-0.87,P=0.03),低评分无显著获益(HR=4.06,95%CI 0.05-31,P=0.53),交互P=0.04。
- 转录组分析显示高风险肿瘤细胞毒性T细胞活性受抑,细胞外基质重塑、中性粒细胞脱颗粒和神经元信号富集。
- NRXN1、GABRA3、KCNK3和KLK12上调与更差生存相关,SYNGR3和CD207与良好结局相关。
临床怎么用
- 可利用MuTriM多模态评分辅助乳腺癌预后分层,并识别可能从辅助放疗中获益的高评分患者。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
PURPOSE: We present MuTriM, a multimodal deep learning model integrating DCE-MRI and whole-slide pathology to predict survival and radiation benefit in breast cancer. PATIENTS AND METHODS: MuTriM employs an attention-based cross-modal and cross-temporal fusion framework that concurrently integrates DCE-MRI radiomic features with pathomic features of cellular morphology on WSI. MuTriM was trained on the Fudan University Shanghai Cancer Center (FUSCC) cohort (N = 335) and externally tested on the TCGA cohort (N = 126) using matched DCE-MRI and WSI. RESULTS: MuTriM was prognostic of recurrence-free survival (RFS) in a subtype-agnostic setting (HR = 5.26, 95% CI, 1.69-16.4, p = 0.004; C-index = 0.75), outperforming unimodal models based on DCE-MRI alone (C-index = 0.65) or WSI alone (C-index = 0.70). MuTriM was also prognostic among HER2 + (HR = 6.82, 95% CI, 1.08-43.2, p = 0.04) and ER+ populations (HR = 4.61, 95% CI, 1.25-17.1, p = 0.02). A high MuTriM score was associated with improved RFS (HR = 0.15, 95% CI 0.03-0.87; P = 0.03), whereas a low MuTriM score showed no significant benefit (HR = 4.06, 95% CI 0.05-31; P = 0.53) (interaction P = 0.04). Transcriptomic analyses revealed that high-risk tumors showed suppressed cytotoxic T-cell activity and enrichment of extracellular matrix remodeling, neutrophil degranulation, and neuronal signaling, consistent with immune evasion. Upregulation of NRXN1, GABRA3, KCNK3, and KLK12 was linked to worse survival, whereas SYNGR3 and CD207 were associated with favorable outcomes. CONCLUSION: By unifying radiology, pathology, and transcriptomics, MuTriM provides an interpretable multimodal framework for breast cancer prognosis and treatment guidance.
引用
- Wang X, Chen L, Sun J, et al. MuTriM: A multiscale deep learning model integrating longitudinal radiomics and pathomic features for predicting recurrence and adjuvant radiation benefit in breast cancer. Eur J Cancer. 2026. PMID: 41850009. doi:10.1016/j.ejca.2026.116679
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。