文献速递类风湿关节炎

人工智能自动进行类风湿关节炎影像学评分:通过综合评估揭示实施障碍

AI automated radiographic scoring in rheumatoid arthritis: Shedding light on barriers to implementation through comprehensive evaluation.
PubMed 文献 · Semin Arthritis Rheum · 2025-06-05

研究开发并严格验证了一种深度学习模型,以Sharp van der Heijde评分自动评估手和足X线,训练队列157例患者1470张X线片,外部测试集来自两家医院253例患者589张X线片。AI系统表现不及人工评分,AI与共识评分的一致性低于两名人工评分者之间的一致性,组内相关系数0.03至0.27,Spearman相关系数0.16至0.55。结论认为该AI系统性能不足以支持在研究或临床实践中使用。

要点

  • AI系统表现不及人工评分,AI与共识评分一致性低于两名人工评分者之间一致性。
  • AI更擅长排序而非绝对一致,组内相关系数0.03至0.27,Spearman相关系数0.16至0.55。
  • 作者结论认为该AI系统性能不足以支持在研究或临床实践中使用。

核心结论

  • 为类风湿关节炎影像学评分自动化而开发的AI系统性能不足以支持在研究或临床实践中使用。
  • 大型、多样且描述充分的纵向数据集对算法开发和严格评估不可或缺。

研究设计与样本

  • 使用157例患者1470张X线片训练AI算法预测手和足Sharp van der Heijde评分。
  • 在两个医院的外部测试集进行外部复制,共253例患者589张X线片。
  • 除标准性能指标外,报告亚组表现、进行误差探索性分析并展示与功能结局的关系。

主要发现

  • AI系统表现不及人工评分,AI与共识评分之间的一致性低于两名人工评分者之间的一致性。
  • AI系统在排序评分方面优于实现绝对一致,组内相关系数范围为0.03至0.27。
  • Spearman相关系数始终较高,范围为0.16至0.55。

临床怎么用

  • 原文结论认为该AI系统性能不足以支持在研究或临床实践中使用。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: Artificial intelligence (AI) has demonstrated the potential to improve efficiency and reliability of radiographic scoring in rheumatoid arthritis but lacks sufficient evidence to justify clinical use. We developed and rigorously validated a deep learning model to automate radiographic scoring against two external test sets, drawing upon state of the art reporting guidelines to clarify present barriers to implementation. METHODS: AI algorithms were trained to predict the Sharp van der Heijde score in hands and feet using a cohort of 157 patients and 1470 radiographs. External replication was undertaken in test datasets from two hospitals (n=253 patients, 589 radiographs). Alongside standard performance metrics to measure error and agreement, we reported subgroup performance, conducted an exploratory analysis of error, and demonstrated relationships with functional outcomes. RESULTS: Our AI system underperformed compared to manual scoring, with lower agreement between the AI and consensus score than between the two manual scorers. The AI system was better at ranking scores than achieving absolute agreement, with intraclass correlation coefficients ranging from 0.03 to 0.27 while Spearman's correlation coefficients were consistently higher, ranging from 0.16 to 0.55. CONCLUSIONS: The performance of the AI systems developed for automating radiographic scoring in RA is insufficient to justify use in research or clinical practice. Large, diverse, and thoroughly described longitudinal datasets will be indispensable in the development and rigorous evaluation of algorithms. Achieving this is key to the ongoing precise evaluation of clinical outcomes in rheumatoid arthritis to enable further improvements to patient care.

来源:Semin Arthritis Rheum,查看原文。版权归原作者所有。

引用

  1. Bird A, Oakden-Rayner L, Chakradeo K, et al. AI automated radiographic scoring in rheumatoid arthritis: Shedding light on barriers to implementation through comprehensive evaluation. Semin Arthritis Rheum. 2025. PMID: 40513204. doi:10.1016/j.semarthrit.2025.152761

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。