文献速递肿瘤 PET/CT

机器学习重采样技术对不平衡数据集在18F-FDG PET影像组学模型中对头颈癌患者预后预测性能的影响

Effect of machine learning re-sampling techniques for imbalanced datasets in 18F-FDG PET-based radiomics model on prognostication performance in cohorts of head and neck cancer patients.
PubMed 文献 · Eur J Nucl Med Mol Imaging · 2020-04-06

研究评估重采样技术对不平衡数据集在PET影像组学预后模型中的影响,纳入本中心166例新诊断鼻咽癌患者和开放数据库182例头颈癌患者。采用10种重采样方法与4种机器学习分类器交叉组合预测总生存和无病进展生存,发现ADASYN和SMOTE等过采样技术可提高少数类的G-mean和F-measures且不显著损失多数类F-measures,本中心鼻咽癌队列最优总生存预测模型AUC为0.82、G-mean为0.77,外部数据集验证显示过采样技术改善预测性能具有泛化性。

要点

  • ADASYN和SMOTE等过采样技术可提高少数类G-mean和F-measures,不显著损失多数类F-measures。
  • 本中心鼻咽癌队列最优PET影像组学总生存预测模型AUC为0.82、G-mean为0.77。
  • 外部数据集验证显示过采样技术改善预测性能,提示泛化性。

核心结论

  • 应用重采样技术对不平衡数据集的预测性能有显著正向影响。
  • 已创建开源解决方案用于自动计算和比较多种重采样技术与机器学习分类器,便于未来研究重复。

研究设计与样本

  • 影像组学分析在两个队列中进行,包括本中心166例新诊断鼻咽癌患者和开放数据库182例头颈癌患者。
  • 提取常规PET参数和稳健影像组学特征,用于总生存和无病进展生存的相关性分析。
  • 研究10种重采样方法(过采样、欠采样和混合采样)与4种机器学习分类器的交叉组合用于生存预测。
  • 在留出测试集中评估诊断性能,使用蒙特卡洛交叉验证及事后Nemenyi分析统计差异。

主要发现

  • ADASYN和SMOTE等过采样技术可提高少数类的G-mean和F-measures,且不显著损失多数类的F-measures。
  • 本中心鼻咽癌队列最优PET影像组学总生存预测模型AUC为0.82、G-mean为0.77。
  • 外部数据集测试也显示过采样技术改善预测性能,提示泛化性。

关键数值与推荐

  • 本中心鼻咽癌队列最优总生存预测模型AUC为0.82、G-mean为0.77。
  • 过采样技术(如ADASYN和SMOTE)提高少数类G-mean和F-measures,不显著损失多数类F-measures。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

PURPOSE: Biomedical data frequently contain imbalance characteristics which make achieving good predictive performance with data-driven machine learning approaches a challenging task. In this study, we investigated the impact of re-sampling techniques for imbalanced datasets in PET radiomics-based prognostication model in head and neck (HNC) cancer patients. METHODS: Radiomics analysis was performed in two cohorts of patients, including 166 patients newly diagnosed with nasopharyngeal carcinoma (NPC) in our centre and 182 HNC patients from open database. Conventional PET parameters and robust radiomics features were extracted for correlation analysis of the overall survival (OS) and disease progression-free survival (DFS). We investigated a cross-combination of 10 re-sampling methods (oversampling, undersampling, and hybrid sampling) with 4 machine learning classifiers for survival prediction. Diagnostic performance was assessed in hold-out test sets. Statistical differences were analysed using Monte Carlo cross-validations by post hoc Nemenyi analysis. RESULTS: Oversampling techniques like ADASYN and SMOTE could improve prediction performance in terms of G-mean and F-measures in minority class, without significant loss of F-measures in majority class. We identified optimal PET radiomics-based prediction model of OS (AUC of 0.82, G-mean of 0.77) for our NPC cohort. Similar findings that oversampling techniques improved the prediction performance were seen when this was tested on an external dataset indicating generalisability. CONCLUSION: Our study showed a significant positive impact on the prediction performance in imbalanced datasets by applying re-sampling techniques. We have created an open-source solution for automated calculations and comparisons of multiple re-sampling techniques and machine learning classifiers for easy replication in future studies.

来源:Eur J Nucl Med Mol Imaging,查看原文。版权归原作者所有。

引用

  1. Xie C, Du R, Ho JW, et al. Effect of machine learning re-sampling techniques for imbalanced datasets in 18F-FDG PET-based radiomics model on prognostication performance in cohorts of head and neck cancer patients. Eur J Nucl Med Mol Imaging. 2020. PMID: 32253486. doi:10.1007/s00259-020-04756-4

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。