使用简约集成机器学习模型评估肺癌筛查资格:一项开发与验证研究
本研究利用英国生物银行216714名及美国国家肺癌筛查试验对照组26616名吸烟者数据,开发简约集成机器学习模型预测5年内肺癌诊断与死亡风险,并在美国前列腺、肺、结直肠和卵巢筛查试验中外部验证。仅用年龄、吸烟年限和包年3个变量的模型在区分度、校准和净获益上达到或超过现有比对模型,但模型尚未在英国和美国队列之外验证。
要点
- 仅用年龄、吸烟年限和包年3个变量的集成机器学习模型可预测5年内肺癌诊断与死亡风险。
- 外部验证中,预测肺癌死亡模型AUC为0.803,预测肺癌发病模型AUC为0.787。
- 在相同特异度下,模型敏感性较USPSTF-2021标准分别高7.9%和6.2%。
核心结论
- 简约集成机器学习模型可预测吸烟者肺癌风险,可能简化风险-based肺癌筛查在多种场景的实施。
研究设计与样本
- 模型开发使用英国生物银行前瞻性队列216714名吸烟者(2006-2010年招募)和美国国家肺癌筛查试验对照组26616名高危吸烟者(2002-2004年招募)。
- 外部验证使用美国前列腺、肺、结直肠和卵巢筛查试验胸片组49593名参与者及所有80659名吸烟参与者。
- 模型预测基线后5年内肺癌诊断和肺癌死亡两个结局,评估区分度、校准、整体性能和净获益。
主要发现
- 外部验证中,预测肺癌死亡模型UCL-D的AUC为0.803(95%CI:0.783,0.824),期望/观察比E/O为1.05(95%CI:0.95,1.19)。
- 预测肺癌发病模型UCL-I的AUC为0.787(95%CI:0.771,0.802),E/O比为1.0(95%CI:0.92,1.07)。
- 在5年风险阈值0.68%和1.17%时,UCL-D敏感性为85.5%,UCL-I敏感性为83.9%,在相同特异度下分别较USPSTF-2021标准高7.9%和6.2%。
- 仅用年龄、吸烟年限和包年3个变量的模型在区分度、整体性能和净获益上达到或超过现有比对模型,且预测变量数仅为比对模型的四分之一。
临床怎么用
- 原文未据此给出临床推荐。
局限性
- 主要局限性是模型尚未在英国和美国队列之外进行验证。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Risk-based screening for lung cancer is currently being considered in several countries; however, the optimal approach to determine eligibility remains unclear. Ensemble machine learning could support the development of highly parsimonious prediction models that maintain the performance of more complex models while maximising simplicity and generalisability, supporting the widespread adoption of personalised screening. In this work, we aimed to develop and validate ensemble machine learning models to determine eligibility for risk-based lung cancer screening. METHODS AND FINDINGS: For model development, we used data from 216,714 ever-smokers recruited between 2006 and 2010 to the UK Biobank prospective cohort and 26,616 high-risk ever-smokers recruited between 2002 and 2004 to the control arm of the US National Lung Screening (NLST) randomised controlled trial. The NLST trial randomised high-risk smokers from 33 US centres with at least a 30 pack-year smoking history and fewer than 15 quit-years to annual CT or chest radiography screening for lung cancer. We externally validated our models among 49,593 participants in the chest radiography arm and all 80,659 ever-smoking participants in the US Prostate, Lung, Colorectal and Ovarian (PLCO) Screening Trial. The PLCO trial, recruiting from 1993 to 2001, analysed the impact of chest radiography or no chest radiography for lung cancer screening. We primarily validated in the PLCO chest radiography arm such that we could benchmark against comparator models developed within the PLCO control arm. Models were developed to predict the risk of 2 outcomes within 5 years from baseline: diagnosis of lung cancer and death from lung cancer. We assessed model discrimination (area under the receiver operating curve, AUC), calibration (calibration curves and expected/observed ratio), overall performance (Brier scores), and net benefit with decision curve analysis. Models predicting lung cancer death (UCL-D) and incidence (UCL-I) using 3 variables-age, smoking duration, and pack-years-achieved or exceeded parity in discrimination, overall performance, and net benefit with comparators currently in use, despite requiring only one-quarter of the predictors. In external validation in the PLCO trial, UCL-D had an AUC of 0.803 (95% CI: 0.783, 0.824) and was well calibrated with an expected/observed (E/O) ratio of 1.05 (95% CI: 0.95, 1.19). UCL-I had an AUC of 0.787 (95% CI: 0.771, 0.802), an E/O ratio of 1.0 (95% CI: 0.92, 1.07). The sensitivity of UCL-D was 85.5% and UCL-I was 83.9%, at 5-year risk thresholds of 0.68% and 1.17%, respectively, 7.9% and 6.2% higher than the USPSTF-2021 criteria at the same specificity. The main limitation of this study is that the models have not been validated outside of UK and US cohorts. CONCLUSIONS: We present parsimonious ensemble machine learning models to predict the risk of lung cancer in ever-smokers, demonstrating a novel approach that could simplify the implementation of risk-based lung cancer screening in multiple settings.
引用
- Callender T, Imrie F, Cebere B, et al. Assessing eligibility for lung cancer screening using parsimonious ensemble machine learning models: A development and validation study. PLoS Med. 2023. PMID: 37788223. doi:10.1371/journal.pmed.1004287
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。