文献速递系统性红斑狼疮

机器学习模型估算SLE疾病活动度指数的验证研究

Validation of a machine learning approach to estimate Systemic Lupus Erythematosus Disease Activity Index score categories and application in a real-world dataset.
PubMed 文献 · RMD Open · 2021-01-01

本研究利用临床笔记开发机器学习模型,估算系统性红斑狼疮疾病活动度指数(SLEDAI)评分类别,并在OM1 SLE注册队列中训练(3504次就诊)和验证(1576次就诊);模型区分SLEDAI>5与≤5的AUC在开发队列为0.93、验证队列为0.91,四分类的Spearman和Pearson R值均为0.7。

要点

  • 机器学习模型可基于临床笔记估算SLEDAI评分类别。
  • 验证队列AUC为0.91,四分类相关系数为0.7。
  • 模型适用于真实世界数据集生成估计评分类别。

核心结论

  • 该模型在利用非结构化临床笔记估算SLEDAI评分类别方面表现良好。

研究设计与样本

  • 研究开发机器学习模型,使用临床笔记估算特定就诊日期的SLEDAI评分类别(无活动、轻度、中度或高/极高活动)。
  • 训练队列包含3504次就诊,验证队列包含1576次就诊,均来自OM1 SLE注册队列。

主要发现

  • 二分类(SLEDAI>5为阳性,≤5为阴性)的AUC在开发队列为0.93,在验证队列为0.91。
  • 按四个疾病活动度类别计算,模型的Spearman R值为0.7,Pearson R值为0.7。

关键数值与推荐

  • SLEDAI评分类别分为无活动、轻度活动、中度活动、高/极高活动四类。
  • 二分类评估以临床医生记录的SLEDAI>5为阳性类,≤5为阴性类。

临床怎么用

  • 在真实世界数据中,可用该模型基于临床笔记生成SLEDAI评分类别估计值,供未来研究使用。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: Use of the Systemic Lupus Erythematosus Disease Activity Index (SLEDAI) in routine clinical practice is inconsistent, and availability of clinician-recorded SLEDAI scores in real-world datasets is limited. This study aimed to validate a machine learning model to estimate SLEDAI score categories using clinical notes and to apply the model to a large, real-world dataset to generate estimated score categories for use in future research studies. METHODS: A machine learning model was developed to estimate an individual patient's SLEDAI score category (no activity, mild activity, moderate activity or high/very high activity) for a specific encounter date using clinical notes. A training cohort of 3504 encounters and a separate validation cohort of 1576 encounters were created from the OM1 SLE Registry. Model performance was assessed using the area under the receiver operating characteristic curve (AUC), calculated using a binarised version of the outcome that sets the positive class to be those records with clinician-recorded SLEDAI scores >5 and the negative class to be records with scores ≤5. Model performance was evaluated by categorising the scores into the four disease activity categories and by calculating the Spearman's R value and Pearson's R value. RESULTS: The AUC for the two categories was 0.93 for the development cohort and 0.91 for the validation cohort. The model had a Spearman's R value of 0.7 and a Pearson's R value of 0.7 when calculated using the four disease activity categories. CONCLUSION: The model performs well when estimating SLEDAI score categories using unstructured clinical notes.

来源:RMD Open,查看原文。版权归原作者所有。

引用

  1. Alves P, Bandaria J, Leavy MB, et al. Validation of a machine learning approach to estimate Systemic Lupus Erythematosus Disease Activity Index score categories and application in a real-world dataset. RMD Open. 2021. PMID: 34016712. doi:10.1136/rmdopen-2021-001586

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。