SNMMI人工智能任务组2024年影像组学挑战赛总结报告
该挑战赛由核医学与分子影像学会人工智能任务组发起,利用基线18F-FDG PET/CT影像组学数据集,比较机器学习模型预测弥漫大B细胞淋巴瘤无进展生存期的性能,结局分为二分类(短于2年 vs 长于2年)和连续变量(月数)。外部验证显示,部分影像组学机器学习模型的性能指标优于仅基于SUV和总代谢肿瘤体积的简单线性或逻辑回归模型,但观察到的差异无统计学显著性。
要点
- 挑战赛比较机器学习模型预测弥漫大B细胞淋巴瘤无进展生存期。
- 19个连续结局模型来自15个团队,12个二分类模型来自9个团队。
- 外部验证中,部分影像组学模型性能优于仅用SUV和TMTV的简单模型,但差异无统计学显著性。
核心结论
- 部分参赛影像组学机器学习模型的性能指标优于仅基于SUV和总代谢肿瘤体积的简单线性或逻辑回归模型,但观察到的性能指标差异无统计学显著性。
- 这提示对于该挑战赛数据集,在开发结局预测模型时加入复杂影像组学特征并使用机器学习带来的价值有限或没有价值。
研究设计与样本
- 该挑战赛由核医学与分子影像学会人工智能任务组发起并获得认可,旨在比较预测弥漫大B细胞淋巴瘤患者无进展生存期的机器学习模型。
- 所有参与者获得影像组学训练数据集(含用于设计预测模型的真实生存结局)和不含真实结局的影像组学测试数据集。
- 无进展生存期预测分为二分类结局(短于2年 vs 长于2年)或连续结局(生存月数)。
- 评估模型性能的指标为:连续结局用均方根误差,1年、2年和3年无进展生存期二分类结局用C指数。
主要发现
- 共收到来自15个团队的19个预测连续结局的模型;外部验证识别出6个模型与仅使用SUV和总代谢肿瘤体积的简单通用线性参考模型性能相似。
- 共收到来自9个团队的12个预测二分类结局的模型;外部验证显示1个模型的C指数值高于仅使用SUV和总代谢肿瘤体积的简单逻辑回归模型所得值,但差异无统计学显著性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
In medical imaging, challenges are competitions that aim to provide a fair comparison of different methodologic solutions to a common problem. Challenges typically focus on addressing real-world problems, such as segmentation, detection, and prediction tasks, using various types of medical images and associated data. Here, we describe the organization and results of such a challenge to compare machine-learning models for predicting survival in patients with diffuse large B-cell lymphoma using a baseline 18F-FDG PET/CT radiomics dataset. Methods: This challenge aimed to predict progression-free survival (PFS) in patients with diffuse large B-cell lymphoma, either as a binary outcome (shorter than 2 y versus longer than 2 y) or as a continuous outcome (survival in months). All participants were provided with a radiomic training dataset, including the ground truth survival for designing a predictive model and a radiomic test dataset without ground truth. Figures of merit (FOMs) used to assess model performance were the root-mean-square error for continuous outcomes and the C-index for 1-, 2-, and 3-y PFS binary outcomes. The challenge was endorsed and initiated by the Society of Nuclear Medicine and Molecular Imaging AI Task Force. Results: Nineteen models for predicting PFS as a continuous outcome from 15 teams were received. Among those models, external validation identified 6 models showing similar performance to that of a simple general linear reference model using SUV and total metabolic tumor volumes (TMTV) only. Twelve models for predicting binary outcomes were submitted by 9 teams. External validation showed that 1 model had higher, but nonsignificant, C-index values compared with values obtained by a simple logistic regression model using SUV and TMTV. Conclusion: Some of the radiomic-based machine-learning models developed by participants showed better FOMs than did simple linear or logistic regression models based on SUV and TMTV only, although the differences in observed FOMs were nonsignificant. This suggests that, for the challenge dataset, there was limited or no value seen from the addition of sophisticated radiomic features and use of machine learning when developing models for outcome prediction.
引用
- Boellaard R, Rahmim A, Eertink JJ, et al. Summary Report of the SNMMI AI Task Force Radiomics Challenge 2024. J Nucl Med. 2025. PMID: 40506239. doi:10.2967/jnumed.124.269425
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。