文献速递类风湿关节炎

验证一种利用机器学习方法估算类风湿关节炎临床疾病活动指数评分的研究

Validation of a machine learning approach to estimate Clinical Disease Activity Index Scores for rheumatoid arthritis.
PubMed 文献 · RMD Open · 2021-01-01

本研究利用OM1类风湿关节炎注册数据构建机器学习模型,从临床笔记中估算临床疾病活动指数(CDAI)评分,训练队列含56177次就诊,验证队列含18726次就诊(其中11985次通过模型置信度过滤)。模型二分类评估的阳性预测值为0.80、阴性预测值为0.84、AUC为0.88;连续CDAI评分的Spearman R值为0.72、Pearson R值为0.69。作者认为模型性能良好,估算的CDAI评分或可用于真实世界数据研究。

要点

  • 模型从临床笔记估算CDAI评分,验证队列二分类评估AUC为0.88。
  • 二分类评估阳性预测值0.80,阴性预测值0.84。
  • 连续CDAI评分评估Spearman R值0.72,Pearson R值0.69。

核心结论

  • 机器学习模型从临床笔记估算CDAI评分表现出良好性能,将模型应用于真实世界数据集或可使估算的CDAI评分用于研究目的。

研究设计与样本

  • 使用OM1类风湿关节炎注册数据开发机器学习模型,从某次风湿科就诊的临床笔记估算CDAI评分值。
  • 训练队列含56177次就诊,验证队列含18726次就诊,其中11985次通过模型衍生置信度过滤。
  • 所有纳入就诊均有临床医生记录的CDAI评分和临床笔记。

主要发现

  • 使用二分类结局评估时,模型阳性预测值为0.80,阴性预测值为0.84,AUC为0.88。
  • 使用连续CDAI数值评分评估时,模型Spearman R值为0.72,Pearson R值为0.69。

关键数值与推荐

  • 模型性能评估指标包括AUC、阳性预测值、阴性预测值、Spearman R值和Pearson R值。
  • 二分类评估基于结局的二值化版本。
  • 验证队列中11985次就诊通过模型衍生置信度过滤。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: Disease activity measures, such as the Clinical Disease Activity Index (CDAI), are important tools for informing treatment decisions and monitoring patient outcomes in rheumatoid arthritis (RA). Yet, documentation of CDAI scores in electronic medical records and other real-world data sources is inconsistent, making it challenging to use these data for research. The purpose of this study was to validate a machine learning model to estimate CDAI scores for patients with RA using clinical notes. METHODS: A machine learning model was developed to estimate CDAI score values using clinical notes from a specific rheumatology visit. Data from the OM1 RA Registry were used to create a training cohort of 56 177 encounters and a separate validation cohort of 18 726 encounters, 11 985 of which passed a model-derived confidence filter; all included encounters had both a clinician-recorded CDAI score and a clinical note. Model performance was assessed using the area under the receiver operating characteristic curve (AUC), positive predictive value (PPV) and negative predictive value (NPV), calculated using a binarised version of the outcome. The Spearman's R and Pearson's R values were also calculated. RESULTS: The model had a PPV of 0.80, NPV of 0.84 and AUC of 0.88 when evaluating performance using the binarised version of the outcome. The model had a Spearman's R value of 0.72 and a Pearson's R value of 0.69 when evaluating performance using the continuous CDAI numeric scores. CONCLUSION: A machine learning model estimates CDAI scores from clinical notes with good performance. Application of the model to real-world data sets may allow estimated CDAI scores to be used for research purposes.

来源:RMD Open,查看原文。版权归原作者所有。

引用

  1. Spencer AK, Bandaria J, Leavy MB, et al. Validation of a machine learning approach to estimate Clinical Disease Activity Index Scores for rheumatoid arthritis. RMD Open. 2021. PMID: 34819386. doi:10.1136/rmdopen-2021-001781

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。