文献速递胸部技术与安全DR

胸片人工智能分诊系统的真实世界评估:一项前瞻性临床研究

Real-World evaluation of an AI triaging system for chest X-rays: A prospective clinical study.
PubMed 文献 · Eur J Radiol · 2024-10-10

本研究在前瞻性多样患者队列中评估LUNIT INSIGHT CXR Triage软件,43名放射科医生在盲法下按正常、非紧急、紧急三级分类评估胸片。AI对正常胸片敏感度89%、特异度93%,对非紧急胸片敏感度93%、特异度91%,对紧急胸片敏感度82%、特异度99%,并在各年龄、性别、族裔亚组中保持高准确度且显著缩短周转时间。

要点

  • AI对紧急胸片的特异度达99%、NPV 98%,有助于优先分诊。
  • AI对正常胸片的敏感度89%、特异度93%,AUC 0.91。
  • 各年龄、性别、族裔亚组敏感度、特异度、AUC均高于84%。

核心结论

  • AI分诊系统在多样患者队列中表现出稳健性能和泛化能力,并显著缩短各亚组周转时间。

研究设计与样本

  • 前瞻性临床研究,评估LUNIT INSIGHT CXR Triage软件,43名放射科医生在盲法下按正常、非紧急、紧急三级分类系统评估胸片,分析性能指标和周转时间。

诊断标准与关键数值

  • 正常胸片:敏感度89%、特异度93%、PPV 83%、NPV 95%、F1分数0.86、AUC 0.91。
  • 非紧急胸片:敏感度93%、特异度91%、PPV 94%、NPV 89%、F1分数0.94、AUC 0.92。
  • 紧急胸片:敏感度82%、特异度99%、PPV 90%、NPV 98%。
  • 亚组分析:各年龄组(年轻、成人、老年)、性别和族裔(华裔、马来裔、印度裔、其他)敏感度、特异度和AUC均高于84%。

局限性

  • 原文指出真实世界适用性和在不同患者队列中的泛化性仍是关注领域。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Chest X-rays (CXRs) are crucial for diagnosing and managing lung conditions. While CXR is a common and cost-effective diagnostic tool, interpreting the high volume of CXRs is challenging due to workforce limitations. Artificial intelligence (AI) offers promise in enhancing efficiency and accuracy. However, real-world applicability and generalizability across diverse patient cohorts remain areas of concerns. In our study, the LUNIT INSIGHT CXR Triage software was evaluated in a diverse patient cohort. Forty-three radiologists, blinded to AI results, assessed CXRs categorized into normal, non-urgent, and urgent using a 3-tier classification system. Performance metrics and turnaround times were analyzed. The AI system demonstrated sensitivity of 89% for normal CXRs, specificity of 93%, PPV of 83%, and NPV of 95%, with an F1 score of 0.86 and an AUC of 0.91. For non-urgent CXRs, sensitivity and specificity were 93% and 91%, with PPV and NPV at 94% and 89%, respectively, and an F1 score of 0.94 and an AUC of 0.92. In the urgent category, sensitivity was 82%, specificity 99%, PPV 90%, and NPV 98%. Subgroup analysis revealed consistently high accuracy across various age groups (Young, Adult, Senior), genders, and ethnicities (Chinese, Malay, Indian, Others), with sensitivity, specificity, and AUC consistently above 84%. The AI system also significantly reduced turnaround times across all subgroups, indicating its robust performance and generalizability in diverse healthcare settings.

来源:Eur J Radiol,查看原文。版权归原作者所有。

引用

  1. Sridharan S, Seah Xin Hui A, Venkataraman N, et al. Real-World evaluation of an AI triaging system for chest X-rays: A prospective clinical study. Eur J Radiol. 2024. PMID: 39405809. doi:10.1016/j.ejrad.2024.111783

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。