机器学习衍生OSA预测工具在大型临床与社区样本中的诊断性能
研究基于年龄、性别、BMI和种族,用机器学习方法构建不依赖患者报告症状的OSA预测工具,并与STOP-BANG比较。在SAGIC临床样本和Sleep Heart Health Study社区样本中,ANN和RF模型的AUC与STOP-BANG相似,提示无症候机器学习工具可用于广泛识别OSA。
要点
- 无症候机器学习模型诊断性能优于逻辑回归。
- ANN和RF在临床与社区样本中AUC与STOP-BANG相似。
- 机器学习算法可能有助于广泛识别OSA。
核心结论
- 使用机器学习且不依赖患者报告症状的OSA预测工具诊断性能优于逻辑回归。
- 在临床和社区样本中,无症候ANN工具与包含症状的常用预测工具STOP-BANG诊断性能相似。
研究设计与样本
- 回顾性队列来自国际SAGIC睡眠诊所的17,448名受试者,随机分为训练集(n=10,469)和验证集(n=6,979)。
- 使用逻辑回归及ANN、RF、核支持向量机,基于年龄、性别、BMI和种族预测OSA状态。
- 在两个前瞻性测试数据集中比较:SAGIC独立临床样本(n=1,613)和Sleep Heart Health Study社区样本(n=5,599)。
主要发现
- 训练和验证数据集中,机器学习模型AUC显著高于逻辑回归(0.61 [0.60-0.62]):ANN 0.68 [0.66-0.69]、RF 0.68 [0.67-0.70]、核支持向量机0.66 [0.65-0.67]。
- SAGIC测试样本中,ANN(0.70 [0.68-0.72])和RF(0.70 [0.68-0.73])的AUC与STOP-BANG(0.71 [0.68-0.72])相似。
- Sleep Heart Health Study测试样本中,ANN(0.72 [0.71-0.74])的AUC与STOP-BANG(0.72 [0.70-0.73])相似。
关键数值与推荐
- 模型比较使用受试者工作特征曲线下面积(AUC)。
- 机器学习模型AUC显著高于逻辑回归(0.61 [0.60-0.62])。
- ANN和RF在SAGIC测试样本中AUC与STOP-BANG相似。
- ANN在Sleep Heart Health Study测试样本中AUC与STOP-BANG相似。
临床怎么用
- 机器学习衍生且无需患者报告症状的算法可能有助于广泛识别OSA。
- 在临床和社区场景中,无症候ANN工具诊断性能与STOP-BANG相似,可作为筛查参考。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Prediction tools without patient-reported symptoms could facilitate widespread identification of OSA. RESEARCH QUESTION: What is the diagnostic performance of OSA prediction tools derived from machine learning using readily available data without patient responses to questionnaires? Also, how do they compare with STOP-BANG, an OSA prediction tool, in clinical and community-based samples? STUDY DESIGN AND METHODS: Logistic regression and machine learning techniques, including artificial neural network (ANN), random forests (RF), and kernel support vector machine, were used to determine the ability of age, sex, BMI, and race to predict OSA status. A retrospective cohort of 17,448 subjects from sleep clinics within the international Sleep Apnea Global Interdisciplinary Consortium (SAGIC) were randomly split into training (n = 10,469) and validation (n = 6,979) sets. Model comparisons were performed by using the area under the receiver-operating curve (AUC). Trained models were compared with the STOP-BANG questionnaire in two prospective testing datasets: an independent clinic-based sample from SAGIC (n = 1,613) and a community-based sample from the Sleep Heart Health Study (n = 5,599). RESULTS: The AUCs (95% CI) of the machine learning models were significantly higher than logistic regression (0.61 [0.60-0.62]) in both the training and validation datasets (ANN, 0.68 [0.66-0.69]; RF, 0.68 [0.67-0.70]; and kernel support vector machine, 0.66 [0.65-0.67]). In the SAGIC testing sample, the ANN (0.70 [0.68-0.72]) and RF (0.70 [0.68-0.73]) models had AUCs similar to those of the STOP-BANG (0.71 [0.68-0.72]). In the Sleep Heart Health Study testing sample, the ANN (0.72 [0.71-0.74]) had AUCs similar to those of STOP-BANG (0.72 [0.70-0.73]). INTERPRETATION: OSA prediction tools using machine learning without patient-reported symptoms provide better diagnostic performance than logistic regression. In clinical and community-based samples, the symptomless ANN tool has diagnostic performance similar to that of a widely used prediction tool that includes patient symptoms. Machine learning-derived algorithms may have utility for widespread identification of OSA.
引用
- Holfinger SJ, Lyons MM, Keenan BT, et al. Diagnostic Performance of Machine Learning-Derived OSA Prediction Tools in Large Clinical and Community-Based Samples. Chest. 2021. PMID: 34717928. doi:10.1016/j.chest.2021.10.023
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。