文献速递胸部技术与安全DR

肺癌检测人工智能胸部X线算法临床评价中的参考标准方法学:一项系统综述

Reference standard methodology in the clinical evaluation of AI chest X-ray algorithms for lung cancer detection: A systematic review.
PubMed 文献 · Eur J Radiol · 2025-09-06

该系统综述检索MEDLINE、Embase、CENTRAL及试验注册库,最终纳入46篇论文,评估24种AI解决方案,发现参考标准方法学(目标异常、参考标准模态、专家小组构成及仲裁技术)存在显著异质性,25%的参考标准参数报告不充分,66%的研究至少一个领域存在高偏倚风险。

要点

  • 参考标准方法学在目标异常、模态、专家小组及仲裁技术方面存在显著异质性。
  • 25%的参考标准参数报告不充分,66%的研究至少一个领域存在高偏倚风险。
  • 患者层面的参考标准应与临床工作流程对齐并遵循报告指南。

核心结论

  • 该综述首次系统描述胸部X线AI分析中患者层面参考标准方法学,发现参考标准方法学显著异质,25%参数报告不充分,66%研究至少一个领域高偏倚风险。

研究设计与样本

  • 系统综述,检索MEDLINE、Embase、CENTRAL及试验注册库,2名评价者独立筛选,分歧由第3名评价者解决;排除缺乏真实世界队列外部验证的研究;使用改良QUADAS-2工具评估偏倚,数据合成遵循SWiM指南;筛选1679篇论文,纳入46篇全文,评估24种AI解决方案。

临床应用与阅片要点

  • 作者建议,进行患者层面诊断算法评价的研究者应确保参考标准与临床工作流程对齐并遵循报告指南。

局限性

  • 局限性包括缺乏前瞻性研究。
  • 25%的参考标准参数报告不充分。
  • 66%的纳入研究至少一个领域存在高偏倚风险。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

BACKGROUND: Lung cancer remains the leading cause of cancer death worldwide, with early diagnosis linked to improved survival. Artificial intelligence (AI) holds promise for augmenting radiologists' workflows in chest X-ray (CXR) interpretation, particularly for detecting thoracic malignancies. However, clinical implementation of this technology relies on robust and standardised reference standard methodology at the patient-level.

PURPOSE: This systematic review aims to describe reference standard methodology in the clinical evaluation of CXR algorithms for lung cancer detection.

MATERIALS AND METHODS: Searches targeted studies on AI CXR analysis across MEDLINE, Embase, CENTRAL, and trial registries. 2 reviewers independently screened titles and abstracts, with disagreements resolved by a 3rd reviewer. Studies lacking external validation in real-world cohorts were excluded. Bias was assessed using a modified QUADAS-2 tool, and data synthesis followed SWiM guidelines.

RESULTS: 1,679 papers were screened with 46 papers included for full paper review. 24 different AI solutions were evaluated across a broad range of research questions. We identified significant heterogeneity in reference standard methodology, including variations in target abnormalities, reference standard modality, expert panel composition, and arbitration techniques. 25 % of reference standard parameters were inadequately reported. 66 % of included studies demonstrated high risk of bias in at least one domain.

DISCUSSION: To our knowledge, this is the first systematic description of patient-level reference standard methodology in CXR AI analysis of thoracic malignancy. To facilitate translational progress in this field, researchers undertaking evaluations of diagnostic algorithms at the patient-level should ensure that reference standards are aligned with clinical workflows and adhere to reporting guidelines. Limitations include a lack of prospective studies.

来源:Eur J Radiol,查看原文。版权归原作者所有。

引用

  1. Duncan SF, Kidd AC, Lampignano JP, et al. Reference standard methodology in the clinical evaluation of AI chest X-ray algorithms for lung cancer detection: A systematic review. Eur J Radiol. 2025. PMID: 40961741. doi:10.1016/j.ejrad.2025.112409

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。