肿瘤学领域使用机器学习开发临床预测模型需要更大样本量:方法学系统综述
该研究检索了2022年12月发表的肿瘤学领域使用机器学习开发二分类结局预测模型的研究,评估样本量论证情况,并计算基于回归模型开发所需的最小样本量(Nmin)与所用样本量比较。36项纳入研究中仅1项论证了样本量,17项(47%)可计算Nmin,其中5项达到Nmin,17项中事件数中位缺口为302例参与者(范围:-21,331至2,298)。作者建议研究者考虑并报告样本量,至少达到回归模型开发所需的最小样本量。
要点
- 36项使用机器学习开发肿瘤预测模型的研究中,仅1项论证了样本量。
- 17项(47%)可计算Nmin,其中5项达到Nmin以精确估计总体风险并减少过拟合。
- 17项中事件数中位缺口为302例参与者(范围:-21,331至2,298)。
核心结论
- 肿瘤学领域使用机器学习开发预测模型的研究很少论证样本量,且样本量常低于Nmin。
- 由于机器学习模型几乎肯定比回归模型需要更大样本量,实际缺口可能更大。
- 作者建议研究者考虑并报告样本量,至少达到开发回归模型所需的最小样本量。
研究设计与样本
- 方法学系统综述,检索Medline(via OVID)数据库2022年12月发表的肿瘤学领域使用机器学习开发二分类结局预测模型的研究。
- 共纳入36项研究,评估样本量论证情况,并计算基于回归模型开发所需的最小样本量(Nmin)与所用样本量比较。
主要发现
- 36项纳入研究中仅1项论证了样本量。
- 17项(47%)研究可计算Nmin,其中5/17项达到Nmin,可精确估计总体风险并最小化过拟合。
- 17项研究中事件数中位缺口为302例参与者(n=17;范围:-21,331至2,298)。
- 17项中另有3项仅达到精确估计总体风险所需的样本量。
关键数值与推荐
- Nmin为开发基于回归的模型所需的最小样本量,用于与机器学习模型开发所用样本量比较。
- 5/17项研究达到Nmin,可精确估计总体风险并最小化过拟合;另3/17项仅达到精确估计总体风险所需样本量。
临床怎么用
- 作者建议研究者在开发预测模型时考虑并报告样本量,至少达到开发回归模型所需的最小样本量。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND OBJECTIVES: Having a sufficient sample size is crucial when developing a clinical prediction model. We reviewed details of sample size in studies developing prediction models for binary outcomes using machine learning (ML) methods within oncology and compared the sample size used to develop the models with the minimum required sample size needed when developing a regression-based model (Nmin). METHODS: We searched the Medline (via OVID) database for studies developing a prediction model using ML methods published in December 2022. We reviewed how sample size was justified. We calculated Nmin, which is the Nmin, and compared this with the sample size that was used to develop the models. RESULTS: Only one of 36 included studies justified their sample size. We were able to calculate Nmin for 17 (47%) studies. 5/17 studies met Nmin, allowing to precisely estimate the overall risk and minimize overfitting. There was a median deficit of 302 participants with the event (n = 17; range: -21,331 to 2298) when developing the ML models. An additional three out of the 17 studies met the required sample size to precisely estimate the overall risk only. CONCLUSION: Studies developing a prediction model using ML in oncology seldom justified their sample size and sample sizes were often smaller than Nmin. As ML models almost certainly require a larger sample size than regression models, the deficit is likely larger. We recommend that researchers consider and report their sample size and at least meet the minimum sample size required when developing a regression-based model.
引用
- Tsegaye B, Snell KIE, Archer L, et al. Larger sample sizes are needed when developing a clinical prediction model using machine learning in oncology: methodological systematic review. J Clin Epidemiol. 2025. PMID: 39814217. doi:10.1016/j.jclinepi.2025.111675
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。