文献速递心脏核医学肿瘤 PET/CT放射性药物与辐射防护

使用机器学习提高改良Duke/ESC 2015标准在疑似人工瓣膜心内膜炎患者中的诊断准确性——一项概念验证研究

Using machine learning to improve the diagnostic accuracy of the modified Duke/ESC 2015 criteria in patients with suspected prosthetic valve endocarditis - a proof of concept study.
PubMed 文献 · Eur J Nucl Med Mol Imaging · 2024-06-21

该概念验证研究基于160例疑似人工瓣膜心内膜炎(PVE)患者的回顾性多中心队列数据,比较四种机器学习算法与改良Duke/ESC 2015(MDE2015)标准的诊断表现。以感染性心内膜炎团队共识结合至少1年随访为复合金标准,机器学习模型灵敏度0.88-0.92、特异度0.85-0.86,AUC 0.930-0.941,优于MDE2015标准将可能病例分别视为阳性或阴性时的表现。

要点

  • MDE2015标准将可能PVE视为阳性时灵敏度0.96、特异度0.60,视为阴性时灵敏度0.74、特异度0.98。
  • 四种机器学习模型灵敏度0.88-0.92、特异度0.85-0.86、AUC 0.930-0.941。
  • 机器学习模型基于与MDE2015标准相同的特征,可量化诊断确定性并便于纳入新标准。

核心结论

  • 在该概念验证研究中,机器学习算法较MDE2015标准所用主次要标准权重系统取得了改善的诊断表现。
  • 这些模型提供可量化的诊断确定性水平,可能增强临床医生的可解释性。
  • 这些模型便于纳入新的和/或改进的标准,例如CTA或[18F]FDG PET/CT等先进影像模态的个体权重。
  • 这些有前景的初步发现需要进一步研究验证,理想情况下应在涵盖疑似感染性心内膜炎全谱患者的前瞻性队列中进行。

研究设计与样本

  • 该研究为概念验证研究,使用一个定义明确的回顾性多中心队列中160例评估疑似PVE患者的数据。
  • 比较了四种机器学习算法与MDE2015标准的诊断预测:Lasso逻辑回归、带梯度提升的决策树(XGBoost)、不带梯度提升的决策树,以及结合这些预测的模型(集成学习)。
  • 所有模型使用与MDE2015标准相同的特征。
  • 最终PVE诊断基于感染性心内膜炎团队共识,使用所有可用临床信息(包括手术所见,若进行手术)并至少随访1年,作为复合金标准。

主要发现

  • 将可能PVE病例视为阳性时,MDE2015标准的灵敏度和特异度分别为0.96和0.60。
  • 将可能PVE病例视为阴性时,MDE2015标准的灵敏度和特异度分别为0.74和0.98。
  • 将可能心内膜炎视为阳性和阴性的方法结合用于ROC分析,得到AUC为0.917。
  • 机器学习模型的灵敏度和特异度分别为:逻辑回归0.92和0.85;XGBoost 0.90和0.85;决策树0.88和0.86;集成学习0.91和0.85。
  • 按相同顺序,机器学习模型的AUC分别为0.938、0.937、0.930和0.941。

关键数值与推荐

  • MDE2015标准将可能PVE视为阳性时灵敏度0.96、特异度0.60。
  • MDE2015标准将可能PVE视为阴性时灵敏度0.74、特异度0.98。
  • 结合两种处理方式的ROC分析AUC为0.917。
  • 逻辑回归灵敏度0.92、特异度0.85、AUC 0.938。
  • XGBoost灵敏度0.90、特异度0.85、AUC 0.937;决策树灵敏度0.88、特异度0.86、AUC 0.930;集成学习灵敏度0.91、特异度0.85、AUC 0.941。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 这些有前景的初步发现需要进一步研究验证,理想情况下应在涵盖疑似感染性心内膜炎全谱患者的前瞻性队列中进行。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

INTRODUCTION: Prosthetic valve endocarditis (PVE) is a serious complication of prosthetic valve implantation, with an estimated yearly incidence of at least 0.4-1.0%. The Duke criteria and subsequent modifications have been developed as a diagnostic framework for infective endocarditis (IE) in clinical studies. However, their sensitivity and specificity are limited, especially for PVE. Furthermore, their most recent versions (ESC2015 and ESC2023) include advanced imaging modalities, e.g., cardiac CTA and [18F]FDG PET/CT as major criteria. However, despite these significant changes, the weighing system using major and minor criteria has remained unchanged. This may have introduced bias to the diagnostic set of criteria. Here, we aimed to evaluate and improve the predictive value of the modified Duke/ESC 2015 (MDE2015) criteria by using machine learning algorithms. METHODS: In this proof-of-concept study, we used data of a well-defined retrospective multicentre cohort of 160 patients evaluated for suspected PVE. Four machine learning algorithms were compared to the prediction of the diagnosis according to the MDE2015 criteria: Lasso logistic regression, decision tree with gradient boosting (XGBoost), decision tree without gradient boosting, and a model combining predictions of these (ensemble learning). All models used the same features that also constitute the MDE2015 criteria. The final diagnosis of PVE, based on endocarditis team consensus using all available clinical information, including surgical findings whenever performed, and with at least 1 year follow up, was used as the composite gold standard. RESULTS: The diagnostic performance of the MDE2015 criteria varied depending on how the category of 'possible' PVE cases were handled. Considering these cases as positive for PVE, sensitivity and specificity were 0.96 and 0.60, respectively. Whereas treating these cases as negative, sensitivity and specificity were 0.74 and 0.98, respectively. Combining the approaches of considering possible endocarditis as positive and as negative for ROC-analysis resulted in an excellent AUC of 0.917. For the machine learning models, the sensitivity and specificity were as follows: logistic regression, 0.92 and 0.85; XGBoost, 0.90 and 0.85; decision trees, 0.88 and 0.86; and ensemble learning, 0.91 and 0.85, respectively. The resulting AUCs were, in the same order: 0.938, 0.937, 0.930, and 0.941, respectively. DISCUSSION: In this proof-of-concept study, machine learning algorithms achieved improved diagnostic performance compared to the major/minor weighing system as used in the MDE2015 criteria. Moreover, these models provide quantifiable certainty levels of the diagnosis, potentially enhancing interpretability for clinicians. Additionally, they allow for easy incorporation of new and/or refined criteria, such as the individual weight of advanced imaging modalities such as CTA or [18F]FDG PET/CT. These promising preliminary findings warrant further studies for validation, ideally in a prospective cohort encompassing the full spectrum of patients with suspected IE.

来源:Eur J Nucl Med Mol Imaging,查看原文。版权归原作者所有。

引用

  1. Ten Hove D, Slart RHJA, Glaudemans AWJM, et al. Using machine learning to improve the diagnostic accuracy of the modified Duke/ESC 2015 criteria in patients with suspected prosthetic valve endocarditis - a proof of concept study. Eur J Nucl Med Mol Imaging. 2024. PMID: 38904778. doi:10.1007/s00259-024-06774-y

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。