ViT影像组学融合模型用于超声淋巴结分类
本研究基于1647张超声图像,构建融合ViT深度学习特征与影像组学特征的多中心淋巴结分类模型ViT-Rad。内部测试AUC为0.95,经少样本域自适应后外部AUC从0.73提升至0.85,优于传统影像组学模型。
要点
- ViT-Rad融合ViT全局特征与手工影像组学特征,分类淋巴结良恶性。
- 少样本域自适应策略可改善跨中心条件下的外部泛化表现。
- 超声淋巴结评估依赖操作者经验,辅助诊断模型有望提升一致性。
核心结论
- ViT-Rad融合影像组学与ViT特征,内部诊断性能良好,经少样本域自适应后外部适应性有所改善。
研究设计与样本
- 内部数据来自中心1(n=1273,平均年龄57±14岁),外部数据来自中心2(n=374,平均年龄52±18岁)。
诊断标准与关键数值
- 内部测试集ViT-Rad AUC为0.95[95%CI 0.91,0.98],准确度为0.90[95%CI 0.85,0.95]。
- 传统影像组学模型内部测试AUC为0.79[95%CI 0.71,0.89],ViT-Rad优于传统模型(P=.006)。
- 域自适应后外部测试AUC从0.73[95%CI 0.69,0.79]提升至0.85[95%CI 0.81,0.90]。
临床应用与阅片要点
- 超声评估淋巴结仍需结合人工诊断经验,ViT-Rad可作为辅助工具使用。
- 跨中心应用时应注意超声图像存在域偏移,域自适应策略可帮助改善外部表现。
局限性
- 研究为回顾性设计,图像来自两家中心,外部验证样本量较小。
- 原文未报告手工勾画感兴趣区的勾画者数量及一致性评估。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND: Ultrasound (US) is widely used for assessing lymph node (LN) status, but its diagnostic accuracy remains highly operator dependent. A robust computer-assisted diagnostic model may enhance clinical performance and improve inter-operator and inter-center consistencies.
PURPOSE: To develop and validate a multimodal fusion model, ViT-Rad, that combines radiomics features and deep learning features derived from vision transformers (ViT) for the classification of benign and malignant LNs in US images.
METHODS: Between February 2016 and November 2023, a total of 1647 ultrasound images were retrospectively collected for analysis. In this multicenter study, we constructed ViT-Rad, a three-module neural network integrating ViT-based global contextual features and radiomics features extracted from manually delineated regions of interest. To address potential cross-center domain shift, we further employed weak/strong augmentation and a few-shot domain adaptation strategy using limited labeled external-center samples.
RESULTS: The model was trained and evaluated on a dataset from Center 1 (n = 1273; mean ± SD age, 57 ± 14 years), and its generalizability was tested on an external dataset from Center 2 (n = 374; mean ± SD age, 52 ± 18 years). ViT-Rad achieved an AUC of 0.95 [95% CI 0.91, 0.98] and an accuracy of 0.90 [95% CI 0.85, 0.95] on the internal test set, outperforming conventional radiomics models (AUC = 0.79, 95% CI 0.71, 0.89; P = .006). With domain adaptation, its AUC on the external set increased from 0.73 [95% CI 0.69, 0.79] to 0.85 [95% CI 0.81, 0.90]. These findings suggest improved adaptation-assisted external performance under cross-center domain shift.
CONCLUSION: By combining radiomics and ViT-derived features, ViT-Rad effectively integrates domain-specific and global contextual information, improving internal diagnostic performance and showing improved external adaptability after few-shot domain adaptation for LN classification on US images.
引用
- Han, Qu, Gunda, et al. ViT-radiomics fusion for lymph node classification in ultrasound images: a multicenter study. Radiol Med. 2026. PMID: 42804147. doi:10.1007/s11547-026-02257-2
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。