文献速递肿瘤 PET/CT核素与放射性配体治疗

多模态视觉问答系统用于PSMA靶向放射性药物治疗的生存预后

Multimodal Visual Question Answering System for Survival Prognosis in PSMA-Targeted Radiopharmaceutical Therapy.
PubMed 文献 · J Nucl Med · 2026-10-15

本研究提出一种模拟医生评估流程的视觉问答框架,整合PSMA影像与临床数据预测mCRPC患者24个月生存。多中心回顾性研究纳入110例接受[177Lu]Lu-PSMA I&T或[177Lu]Lu-PSMA-617治疗的患者,VQA模型准确率达81.8%,外部验证准确率71.9%,优于传统机器学习方法。

要点

  • VQA模型整合SPECT或PET与PSA测量预测24个月生存,准确率81.8%。
  • 外部验证中经少样本微调后准确率71.9%,生存分层优于所有对比方法。
  • VQA模型校准最佳,与真实生存分布无显著差异(log-rank P=0.76),AUC最高0.75。

核心结论

  • 采用模拟医生评估流程的VQA框架在整合影像与实验室数据方面优于传统机器学习,值得未来评估用于PSMA放射配体治疗患者的生存预后。

研究设计与样本

  • 回顾性多中心研究,纳入2个学术机构的110例mCRPC患者,接受[177Lu]Lu-PSMA I&T或[177Lu]Lu-PSMA-617治疗。
  • VQA框架包含三维图像编码器、领域特异性语言模型RadBERT和跨模态变换器,处理基线和2周期后PET/SPECT图像、临床数据及临床查询。
  • 模型训练预测24个月生存,与最先进方法比较,并用[177Lu]Lu-PSMA-617队列进行外部验证。

主要发现

  • VQA模型准确率81.8%(95%CI 0.52-0.95)在整合SPECT或PET图像与PSA测量时。
  • 外部验证经少样本微调后准确率71.9%(95%CI 0.53-0.86),生存分层进一步优于所有最先进方法。
  • VQA模型校准最接近真实生存分布,无显著差异(log-rank检验P=0.76)。
  • ROC分析显示VQA模型曲线下面积最高(0.75)。

临床怎么用

  • VQA框架可辅助整合PSMA影像与临床实验室数据,用于mCRPC患者接受PSMA放射性药物治疗的生存预后评估。

局限性

  • 初步概念验证结果,样本量有限,需未来进一步评估。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

Large language models show great promise for clinical decision support but generally lack medical imaging integration. Therefore, vision-language models have been proposed, but there is little evidence on their performance, particularly compared with conventional machine learning. Prostate-specific membrane antigen (PSMA)-targeted radiopharmaceutical therapy is a well-established treatment for metastatic castration-resistant prostate cancer (mCRPC), but it is still not known which patients will be good long-term responders. Therefore, this study proposes a physician-inspired visual question answering (VQA) framework that emulates the structured integration of PSMA-directed imaging and clinical data used in routine clinical assessment for overall survival prognostication. Methods: As a proof of concept, we conducted a retrospective, multicenter study across 2 academic institutions that included 110 patients with mCRPC who were treated with either [177Lu]Lu-PSMA I&T or [177Lu]Lu-PSMA-617. Our VQA approach incorporates a 3-dimensional image encoder, the domain-specific language model RadBERT, and a cross-modal transformer to process baseline and interim (after 2 cycles) PET and SPECT images, clinical data, and clinical query. The model was trained to predict 24-mo survival, and performance was compared with state-of-the-art approaches. External validation was performed with the [177Lu]Lu-PSMA-617 cohort. Results: The VQA model outperformed all state-of-the-art approaches while showing accuracy comparable to the query-free attention multimodal fusion model. Specifically, it achieved 81.8% accuracy (95% CI, 0.52-0.95) when integrating SPECT or PET images with prostate-specific antigen measurements. External validation of the VQA showed 71.9% accuracy (95% CI, 0.53-0.86) after few-shot fine-tuning, with further improvement over all state-of-the-art approaches in survival stratification. The VQA approach showed the closest calibration with the ground-truth survival distribution, with no significant differences observed (log-rank test, P = 0.76). Receiver operating characteristic analysis showed the highest area under the curve (0.75) among the evaluated models. Together, these findings suggest that the VQA approach demonstrated adaptability across different PSMA ligands while maintaining slightly improved yet comparable overall survival prognostic performance. Conclusion: By adopting a physician-inspired assessment workflow, the VQA framework shows advantages in integrating imaging and laboratory data for clinical decision support compared with conventional machine learning. The preliminary results indicate that VQA-based approaches warrant future evaluation for survival prognostication in patients with mCRPC who are receiving PSMA radiopharmaceutical therapy.

来源:J Nucl Med,查看原文。版权归原作者所有。

引用

  1. Kassar M, Hu J, Rauscher I, et al. Multimodal Visual Question Answering System for Survival Prognosis in PSMA-Targeted Radiopharmaceutical Therapy. J Nucl Med. 2026. PMID: 42880965. doi:10.2967/jnumed.125.271912

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。