文献速递胸部DR

商用人工智能设备在胸片肺癌检测中的独立头对头比较

Independent Head-to-Head Comparison of Commercial Artificial Intelligence Devices for Lung Cancer Detection on Chest Radiographs.
PubMed 文献 · Radiology · 2026-01-01

该研究在单中心连续纳入5235例成人胸片,由7家厂商的商用AI设备独立分析,以多学科团队决策为参考标准。各设备AUC为0.80-0.94,敏感度20.8%-77.8%,特异度58.9%-98.4%,阳性预测值1.5%-28.4%,分类结果一致性极低(κ=0.24)。结论认为商用AI设备在胸片肺癌检测中的诊断准确性存在临床和统计学显著差异。

要点

  • 不同商用AI设备肺癌检测性能差异显著,AUC范围0.80-0.94,敏感度20.8%-77.8%。
  • 设备间分类结果一致性极低(κ=0.24),提示不能互换使用。
  • 与放射科医师报告相比,AI额外假阳性结果数量从10到2039不等。

核心结论

  • 商用AI设备在胸片肺癌检测中的诊断准确性存在临床和统计学显著差异。

研究设计与样本

  • 单中心回顾性研究,纳入2020年7月至2021年2月连续5235例成人胸片(中位年龄60岁,53.4%女性),来自7家厂商的AI设备独立分析,以多学科团队决策为参考标准。

诊断标准与关键数值

  • 各设备AUC为0.80-0.94(15组两两比较中9组P<.05)。
  • 敏感度20.8%-77.8%,特异度58.9%-98.4%,阳性预测值1.5%-28.4%(P<.001,44组两两比较中39组P<.05)。
  • 设备间分类结果一致性Fleiss κ=0.24。
  • 与放射科医师报告相比,AI额外假阳性结果数量为10至2039。

临床应用与阅片要点

  • 临床部署AI设备前需了解其在本机构人群中的性能,不同设备不可互换。
  • AI高假阳性可能增加额外召回,需结合放射科医师判读综合评估。

局限性

  • 单中心研究,结果外推需谨慎。
  • 肺癌患病率1.4%(可见肿瘤),为代表性患病率样本。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Background Various commercial artificial intelligence (AI) devices can identify lung cancer features on chest radiographs. Understanding their relative performance within the same patient population and health care setting is essential for making informed clinical deployment decisions. Purpose To determine and compare the diagnostic accuracy of multiple commercial AI devices for lung cancer detection on chest radiographs in a patient sample demonstrating a representative prevalence. Materials and Methods Consecutive chest radiographs requested from primary care for any indication in adult patients acquired at a single United Kingdom center between July 2020 and February 2021 were eligible for inclusion. Each radiograph was independently analyzed by each device. The multidisciplinary team decision served as the reference standard for diagnosis. Receiver operating characteristic analysis was performed for continuous scores, with the DeLong test used to compare the area under the receiver operating characteristic curve for the devices. Contingency tables of device classification results were used to calculate diagnostic accuracy metrics. The Cochran Q and McNemar tests were used to compare proportions of classification results between the devices. Fleiss κ was used to assess the agreement of classification results across the devices. Results A total of 5235 radiographs were obtained from 5235 patients (median age, 60 years; 53.4% female, 79.4% White, and 1.4% diagnosed with lung cancer with a visible tumor). Devices from seven manufacturers were tested. The area under the receiver operating characteristic curve varied (0.80-0.94; P < .05 for nine of 15 pairwise comparisons). The sensitivity (20.8%-77.8%), specificity (58.9%-98.4%), and positive predictive value (1.5%-28.4%) varied (P < .001 and P < .05 for 39 of 44 pairwise comparisons). The number of additional false-positive results for tumor detection compared with radiologist reporting ranged from 10 to 2039. Device classification results showed minimal agreement (κ = 0.24). Conclusion There was clinically and statistically significant variability in the diagnostic accuracy of commercial AI devices for lung cancer detection at chest radiography. © RSNA, 2026 Supplemental material is available for this article. See also the editorial by Schaefer-Prokop and Schalekamp in this issue.

来源:Radiology,查看原文。版权归原作者所有。

引用

  1. Maiter A, Taylor J, Metherall P, et al. Independent Head-to-Head Comparison of Commercial Artificial Intelligence Devices for Lung Cancer Detection on Chest Radiographs. Radiology. 2026. PMID: 42153831. doi:10.1148/radiol.252205

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。