量化并改进生物样本库环境下类风湿关节炎算法的性能
该回顾性队列研究在Mayo Clinic生物样本库和Mayo Clinic Tapestry研究中验证1,316例确诊类风湿关节炎(RA)患者和82,123例非RA对照,评估基于规则和eMERGE RA算法的阳性预测值(PPV),并开发基于LASSO机器学习的新算法;基于规则和eMERGE算法在生物样本库中性能劣于行政数据环境,新算法在90% PPV下灵敏度较eMERGE提高4-11%。
要点
- 3个RA编码的PPV为43%,编码联合DMARD为54%,编码联合DMARD及血清阳性为85%。
- eMERGE RA算法的PPV为77%。
- 在90% PPV下,新RA算法灵敏度较eMERGE提高4-11%。
核心结论
- 基于规则和eMERGE RA算法在生物样本库中的性能劣于行政数据环境。
- 本研究开发的新RA算法性能优于这些标准算法。
研究设计与样本
- 本研究为Mayo Clinic生物样本库和Mayo Clinic Tapestry研究内的回顾性队列研究。
- 截至2022年7月18日,以至少两个RA编码或抗环瓜氨酸肽抗体(CCP)阳性联合改善病情抗风湿药(DMARD)处方识别RA病例,由风湿科医师手动核实所有RA病例,其余生物样本库参与者为非RA对照。
- 采用阳性预测值(PPV)评估基于规则和电子病历与基因组学(eMERGE)RA算法,并开发基于LASSO机器学习方法的新RA算法,采用五折交叉验证。
主要发现
- 共确认1,316例RA病例(Mayo Clinic生物样本库968例,Tapestry 348例,70%血清阳性)和82,123例非RA对照(平均年龄65岁,61%女性)。
- 3个RA编码的PPV为43%,编码联合DMARD为54%,编码联合DMARD及血清阳性为85%。
- eMERGE RA算法的PPV为77%。
- 在Mayo Clinic生物样本库中,自报RA(PPV 10%)仅轻微改善算法性能(PPV从83%至85%),而RA家族史(PPV 3%)使性能变差。
- 在90% PPV下,纳入抗CCP和DMARD使用等关键变量的新RA算法较eMERGE灵敏度提高4-11%。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: To quantify and improve the performance of standard rheumatoid arthritis (RA) algorithms in a biobank setting. METHODS: This retrospective cohort study within the Mayo Clinic (MC) Biobank and MC Tapestry Study identified RA cases by presence of at least two RA codes OR positive anti-cyclic citrullinated peptide antibodies (CCP) plus disease-modifying anti-rheumatic drug (DMARD) prescription as of 7/18/2022. Rheumatology physicians manually verified all RA cases using RA criteria and/or rheumatology physician diagnosis plus DMARD use. All other biobank participants served as non-RA controls. We defined seropositivity as rheumatoid factor and/or anti-CCP positivity. We assessed rules-based and Electronic Medical Records and Genomics (eMERGE) RA algorithms using positive predictive value (PPV). Finally, we developed a novel RA algorithm using a LASSO-based machine learning approach with five-fold cross validation. RESULTS: We identified 1,316 confirmed RA cases (968 MC Biobank, 348 Tapestry, 70 % seropositive) and 82,123 non-RA controls (mean age 65, 61 % female). The PPV of 3 RA codes was 43 %, codes plus DMARD was 54 %, and codes plus DMARD plus seropositivity was 85 %. The PPV of eMERGE was 77 %. Available in the MC Biobank, self-reported RA (PPV 10 %) only minimally improved algorithm performance (PPV from 83 % to 85 %), whereas family history of RA (PPV 3 %) worsened performance. At 90 % PPV, the novel RA algorithm incorporating key variables such as anti-CCP and DMARD use increased sensitivity by 4-11 % compared to eMERGE. CONCLUSION: Rules-based and eMERGE RA algorithms had worse performance in biobank than administrative settings. Our novel RA algorithm outperformed these standard algorithms.
引用
- Kronzer VL, Williamson KA, Hanson AC, et al. Quantifying and improving rheumatoid arthritis algorithm performance in biobank settings. Semin Arthritis Rheum. 2025. PMID: 40024070. doi:10.1016/j.semarthrit.2025.152668
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。