临床元数据与[18F]FDG PET/CT影像深度融合用于非小细胞肺癌组织学亚型分型:多中心研究
本研究开发并验证了一个多模态深度学习框架,将临床元数据与[18F]FDG PET/CT影像整合,用于非小细胞肺癌的组织学亚型分型,并以二分类临床分期作为辅助正则化任务。多中心手术队列共780例,分为开发集675例和独立外部测试集105例。框架先用3D Transformer进行基于边界框的肿瘤定位,再用多任务网络通过FiLM将临床元数据动态注入视觉主干。在验证队列中,腺癌与鳞癌分型的AUC达0.894,显著优于常规影像组学基线(AUC=0.796,P=0.017)和仅临床基线(AUC=0.759,P=0.004)。
要点
- 多模态框架在验证队列腺癌与鳞癌分型AUC为0.894,优于影像组学和仅临床基线。
- 独立外部测试集AUC为0.787,跨中心稳定性优于对照模型但差异未达统计学显著。
- FiLM机制注入临床先验使辅助分期任务AUC提升至0.656。
核心结论
- 结合3D检测与早期临床-生物学融合策略可有效提升[18F]FDG PET/CT对非小细胞肺癌的表征能力。
- 该框架有潜力克服单模态影像在解决[18F]FDG摄取表型重叠的诊断模糊病例中的局限性。
- 该工具可为非小细胞肺癌的精准管理提供无创决策支持。
研究设计与样本
- 多中心手术非小细胞肺癌队列共780例,分为开发集675例和独立外部测试集105例。
- 框架先用3D Transformer进行基于边界框的肿瘤定位。
- 多任务网络采用Feature-wise Linear Modulation(FiLM)将临床元数据动态注入视觉主干。
- 以二分类临床分期(早期vs晚期)作为辅助正则化任务。
主要发现
- 验证队列中腺癌与鳞癌分型多模态框架AUC为0.894(95%CI:0.813-0.959),显著优于常规影像组学基线(AUC=0.796,DeLong检验P=0.017)和仅临床基线(AUC=0.759,P=0.004)。
- 内部测试集多模态模型AUC为0.832(95%CI:0.744-0.906),数值上优于竞争模型但差异均未达统计学显著(所有P>0.11)。
- 独立外部测试队列多模态框架AUC为0.787(95%CI:0.687-0.876)。
- 外部队列中多模态框架与仅临床模型(AUC=0.740,P=0.480)或仅影像模型(AUC=0.685,P=0.082)的AUC差异未达统计学显著。
- 多模态框架取得最高F1评分,并在决策曲线分析中于广泛阈值概率范围内获得最优净临床获益;辅助分期任务中FiLM机制将AUC提升至0.656。
临床怎么用
- 该框架可作为无创决策支持工具,辅助解决[18F]FDG摄取表型重叠的非小细胞肺癌诊断模糊病例。
- 临床元数据与PET/CT影像融合策略有助于提升组织学亚型分型的跨中心稳定性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
PURPOSE: To develop and validate a multimodal deep learning framework that integrates clinical metadata with [18F]FDG PET/CT imaging to resolve overlapping metabolic phenotypes. The primary objective is the histological subtyping of non-small cell lung cancer (NSCLC), utilizing binary clinical staging (early vs. advanced) strategically as an auxiliary regularization task. METHODS: A multi-center surgical NSCLC cohort (n = 780) was partitioned into a development set (n = 675) and an independent external test set (n = 105). The framework first utilized a 3D Transformer for bounding-box-based tumor localization. Subsequently, a multi-task network employed Feature-wise Linear Modulation (FiLM) to dynamically inject clinical metadata into the visual backbone. RESULTS: For histological subtyping of adenocarcinoma versus squamous cell carcinoma, in the validation cohort, the proposed multimodal framework achieved the highest area under the receiver operating characteristic curve (AUC) of 0.894 (95% CI: 0.813-0.959), significantly outperforming the conventional radiomics baseline (AUC = 0.796, DeLong test P = 0.017) and the clinical-only baseline (AUC = 0.759, P = 0.004). On the internal test set, the multimodal model maintained an AUC of 0.832 (95% CI: 0.744-0.906), outperforming competing models numerically, though differences did not reach statistical significance (all P > 0.11). On the independent external test cohort, the multimodal framework demonstrated superior cross-center stability, maintaining an AUC of 0.787 (95% CI: 0.687-0.876). On the external cohort, the between-model AUC differences did not reach statistical significance against the clinical-only model (AUC of 0.740, P = 0.480) or the image-only model (AUC of 0.685, P = 0.082). Nevertheless, the multimodal framework achieved the highest F1-score and yielded the most optimal net clinical benefit across a wide range of threshold probabilities in decision curve analysis. For the intrinsically challenging auxiliary staging task, the unguided image-only network exhibited severe vulnerability, however, the FiLM-based multimodal mechanism effectively enhanced diagnostic capacity by employing systemic clinical priors, improving the AUC to 0.656. CONCLUSION: Combining 3D detection with an early clinico-biological fusion strategy effectively enhances NSCLC characterization on [18F]FDG PET/CT, which has the potential to mitigate the limitations of single-modality imaging in resolving diagnostically ambiguous cases characterized by overlapping [18F]FDG uptake phenotypes, thereby providing a non-invasive decision-support tool in the precision management of NSCLC.
引用
- Zhang J, Zhang X, Wang J, et al. Deep integration of clinical metadata with [18F]FDG PET/CT imaging for histological subtyping in non-small cell lung cancer: a multi-center study. Eur J Nucl Med Mol Imaging. 2026. PMID: 42310216. doi:10.1007/s00259-026-08010-1
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。